Golang : http.Get example
Grabbing content in raw HTML format is useful for crawling or parsing purpose. This short tutorial demonstrates how easy it is to get the content of a website with http.Get()
function.
package main
import (
"fmt"
"io/ioutil"
"net/http"
"os"
)
func main() {
// http.Get() can handle gzipped data response
// automagically
resp, err := http.Get("https://golang.org")
if err != nil {
fmt.Println(err)
os.Exit(1)
}
defer resp.Body.Close()
htmlData, err := ioutil.ReadAll(resp.Body)
if err != nil {
fmt.Println(err)
os.Exit(1)
}
fmt.Println(os.Stdout, string(htmlData))
}
run this code and if everything goes well, you should see a bunch of HTML data being printed out.
NOTE : If you encounter crypto error regarding ssl connection, upgrade your Golang to latest version if problem persists, upgrade the certs on your machine
Reference :
See also : Golang : Download file example
By Adam Ng
IF you gain some knowledge or the information here solved your programming problem. Please consider donating to the less fortunate or some charities that you like. Apart from donation, planting trees, volunteering or reducing your carbon footprint will be great too.
Advertisement
Tutorials
+44.3k Golang : Use wildcard patterns with filepath.Glob() example
+11.9k Golang : Print UTF-8 fonts on image example
+4.3k Java : Generate multiplication table example
+6.3k Golang : How to determine if request or crawl is from Google robots
+15.1k Golang : invalid character ',' looking for beginning of value
+14.6k Golang : Search folders for file recursively with wildcard support
+5.7k AWS S3 : Prevent Hotlinking policy
+6.4k Golang : Experimental emojis or emoticons icons programming language
+33.6k Golang : Call a function after some delay(time.Sleep and Tick)
+5k Javascript : Change page title to get viewer attention
+10.2k Generate Random number with math/rand in Go
+19.4k Golang : Archive directory with tar and gzip