Golang : Use NLP to get sentences for each paragraph example
Instead of reading ALL the news with human eyes to find out what's going on with the economy or market trend, it would be a good idea to get the computer to do the heavy lifting and only alert us humans on important news. The program can pickup certain verbs or person names( such as reserve banks governors ) and weight how important the news article is according to some criteria. If ... let say the news article hit certain scores, then generate an alert or trigger an action to either LONG or SHORT a trading instrument.
Below is part of a larger program that uses natural language processing(NLP) to break down a given news article into individual paragraph and each sentences in the paragraph.
Here you go!
package main
import (
"fmt"
"log"
"strings"
"gopkg.in/jdkato/prose.v2"
)
func main() {
text := `EURUSD’s uptrend may be accelerated if US consumer confidence comes in below the 131.0 estimate and Fed Chairman Jerome Powell’s economic outlook bolsters market expectations of rate cuts. Overnight index swaps are pricing in a 100 percent probability of a cut from the July meeting through year-end. However, rhetoric from the central bank has not indicated that policymakers are feeling dovish to that degree.
However, hawkish members of the Fed are finding it increasingly difficult to justify their position in light of US growth. Since February, economic activity out of the US has been broadly underperforming relative to economists’ expectations – signaling that analysts are over estimating the economy’s strength. Inflationary pressure has also been waning alongside a deterioration in global trade due to the US-China trade war.`
// count how many paragraph
paragraph := strings.Split(text, "\n")
//fmt.Println("Paragraph 0 : ", paragraph[0])
//fmt.Println("Paragraph 1 : ", paragraph[1])
// Create a new document for each paragraph
for k, v := range paragraph {
fmt.Println("Processing paragraph ", k, " : ")
doc, err := prose.NewDocument(v)
if err != nil {
log.Fatal(err)
}
// Iterate over the doc's sentences:
for _, sent := range doc.Sentences() {
fmt.Println("["+sent.Text)
}
}
}
Processing paragraph 0 :
[EURUSD’s uptrend may be accelerated if US consumer confidence comes in below the 131.0 estimate and Fed Chairman Jerome Powell’s economic outlook bolsters market expectations of rate cuts.]
[Overnight index swaps are pricing in a 100 percent probability of a cut from the July meeting through year-end.]
[However, rhetoric from the central bank has not indicated that policymakers are feeling dovish to that degree.]
Processing paragraph 1 :
[However, hawkish members of the Fed are finding it increasingly difficult to justify their position in light of US growth.]
[Since February, economic activity out of the US has been broadly underperforming relative to economists’ expectations – signaling that analysts are over estimating the economy’s strength.]
[Inflationary pressure has also been waning alongside a deterioration in global trade due to the US-China trade war.]
See also : Golang : Get FX sentiment from website example
By Adam Ng(黃武俊)
IF you gain some knowledge or the information here solved your programming problem. Please consider donating to the less fortunate or some charities that you like. Apart from donation, planting trees, volunteering or reducing your carbon footprint will be great too.
Advertisement
Tutorials
+9.5k Golang : ffmpeg with os/exec.Command() returns non-zero status
+7.7k Golang : What fmt.Println() can do and println() cannot do
+6.5k Golang : Reverse by word
+7k CloudFlare : Another way to get visitor's real IP address
+18.1k Golang : Read binary file into memory
+15.9k Golang : How to check if input from os.Args is integer?
+4.2k Linux/MacOSX : Search and delete files by extension
+21.5k Golang : Use TLS version 1.2 and enforce server security configuration over client
+6.6k How to let Facebook Login button redirect to a particular URL ?
+6.6k Swift : substringWithRange() function example
+12.4k Golang : Drop cookie to visitor's browser and http.SetCookie() example
+7.9k How to show different content from website server when AdBlock is detected?