Golang : Gzip file example
This tutorial is to fulfill a request from a student learning Golang in Senegal.
His question is how to gzip a file in Golang. Most of the online articles he found only show how to compress some bytes of text but not how to compress a file. This tutorial will show how to read an uncompress file content into a buffer, gzip the buffer and write out the buffer content into a new file.
Here we go :
package main
import (
"bufio"
"bytes"
"compress/gzip"
"flag"
"fmt"
"io/ioutil"
"os"
)
func main() {
flag.Parse() // get the arguments from command line
filename := flag.Arg(0)
if filename == "" {
fmt.Println("Usage : go-gzip sourcefile")
os.Exit(1)
}
rawfile, err := os.Open(filename)
if err != nil {
fmt.Println(err)
os.Exit(1)
}
defer rawfile.Close()
// calculate the buffer size for rawfile
info, _ := rawfile.Stat()
var size int64 = info.Size()
rawbytes := make([]byte, size)
// read rawfile content into buffer
buffer := bufio.NewReader(rawfile)
_, err = buffer.Read(rawbytes)
if err != nil {
fmt.Println(err)
os.Exit(1)
}
var buf bytes.Buffer
writer := gzip.NewWriter(&buf)
writer.Write(rawbytes)
writer.Close()
err = ioutil.WriteFile(filename+".gz", buf.Bytes(), info.Mode())
// use 0666 to replace info.Mode() if you prefer
if err != nil {
fmt.Println(err)
os.Exit(1)
}
fmt.Printf("%s compressed to %s\n", filename, filename + ".gz")
}
Sample tests result :
./go-gzip
Usage : go-gzip sourcefile
./go-gzip uncompressed.txt
uncompressed.txt compressed to uncompressed.txt.gz
References :
http://golang.org/pkg/compress/gzip/#NewWriter
https://www.socketloop.com/tutorials/golang-read-binary-file-into-memory
See also : Golang : Gunzip file
By Adam Ng
IF you gain some knowledge or the information here solved your programming problem. Please consider donating to the less fortunate or some charities that you like. Apart from donation, planting trees, volunteering or reducing your carbon footprint will be great too.
Advertisement
Tutorials
+27.8k Golang : Get first few and last few characters from string
+4.8k Golang : Fix opencv.LoadHaarClassifierCascade The node does not represent a user object error
+23.7k Golang : Convert long hexadecimal with strconv.ParseUint example
+11.9k Golang : List objects in AWS S3 bucket
+5.3k Apt-get to install and uninstall Golang
+9.2k Golang : Convert file unix timestamp to UTC time example
+4.4k Golang : Generate Interleaved 2 inch by 5 inch barcode
+5.9k Golang : Calculate BMI and risk category
+18.5k Android Studio : AlertDialog and EditText to get user string input example
+6.1k Ubuntu : connect() to unix:/var/run/php5-fpm.sock failed (13: Permission denied) while connecting to upstream
+7k Findstr command the Grep equivalent for Windows