Providing Structured Data

Upgrade your rooted Google Play Edition

Have you ever been annoyed by accidentally touching the touchpad on your laptop when you are typing? I am using a Linux laptop with both trackpoint and touchpad so the touchpad is just an annoying redundant thing. Here is the one-liner to disable it: xinput list | grep TouchPad | grep -Po 'id=\K([0-9]+)' | xargs xinput disable

This script performs the build, test and automatic checking of a Go package and its sub-packages using: gofmt goimports golint go vet ineffassign race detector test coverage on package and its sub-packages, /vendor directories excluded goveralls gocyclo misspell Migrated from my Gist. Dependencies To setup all the dependencies need to run the script do: $ go get -v github.com/client9/misspell/cmd/misspell $ go get -v github.com/fzipp/gocyclo $ go get -v github.com/golang/lint/golint $ go get -v github.com/gordonklaus/ineffassign $ go get -v github.com/h12w/gosweep $ go get -v github.com/mattn/goveralls $ go get -v golang.org/x/tools/cmd/goimports Environment variables GOCYCLO_COMPLEXITY: maximum allowed function complexity threshold (default: 5). MISSPELL_LOCALE: English locale (default: US). If you wish to set this for a project you can create a .gosweep file. For example: ...

Getgo is a concurrent, simple and extensible web scraping framework written in Go. Quick start Get Getgo go get -u github.com/h12w/getgo Define a task This example is under the examples/goblog directory. To use Getgo to scrap structured data from a web page, just define the structured data as a Go struct (golangBlogEntry), and define a corresponding task (golangBlogIndexTask). type golangBlogEntry struct { Title string URL string Tags *string } type golangBlogIndexTask struct { // Variables in task URL, e.g. page number } func (t golangBlogIndexTask) Request() *http.Request { return getReq(`http://blog.golang.org/index`) } func (t golangBlogIndexTask) Handle(root *query.Node, s getgo.Storer) (err error) { root.Div(_Id("content")).Children(_Class("blogtitle")).For(func(item *query.Node) { title := item.Ahref().Text() url := item.Ahref().Href() tags := item.Span(_Class("tags")).Text() if url != nil && title != nil { store(&golangBlogEntry{Title: *title, URL: *url, Tags: tags}, s, &err) } }) return } Run the task Use util.Run to run the task and print all the result to standard output. ...

GSpec is an expressive, reliable, concurrent and extensible Go test framework that makes it productive to organize and verify the mind model of software. ...

html-query is a Go package that provides a fluent and functional interface for querying HTML DOM. It is based on go.net/html. Examples A simple example (under “examples” directory) r := get(`http://blog.golang.org/index`) defer r.Close() root, err := query.Parse(r) checkError(err) root.Div(Id("content")).Children(Class("blogtitle")).For(func(item *query.Node) { href := item.Ahref().Href() date := item.Span(Class("date")).Text() tags := item.Span(Class("tags")).Text() // ...... }) Generator of html-query (under “gen” directory) A large part of html-query is automatically generated from HTML spec. The spec is in HTML format, so the generator parses it using html-query itself. ...

Cwrap is a Go wrapper generator for C libraries. Features No Cgo types exposed out of the wrapper package, and uses as less allocation/copy as possible. C name prefix mapped to Go packages, and a wrapper package can import another wrapper package. Follows Go naming conventions. C union. Use Go language features when possible: string and bool. Multiple return values. Slice, slice of slice and slice of string. struct with methods. Go closures as callbacks. Stay out of the way when you need to do it manually for specified declarations. Usage Cwrap itself is a Go package rather than an executable program. Just fill a cwrap.Package struct literal and call its Wrap method to generate your wrapper package under $GOPATH. Here is a simple example: ...

xsd is a Go package that generates tagged struct from XML Schema (xsd). When only the XML file is available, an xsd file can be automatically generated by a XML Schema learner, such as “github.com/kore/XML-Schema-learner”.

SOCKS is a SOCKS4, SOCKS4A and SOCKS5 proxy package for Go. Quick Start Get the package go get -u "h12.io/socks" Import the package import "h12.io/socks" Create a SOCKS proxy dialling function dialSocksProxy := socks.Dial("socks5://127.0.0.1:1080?timeout=5s") tr := &http.Transport{Dial: dialSocksProxy} httpClient := &http.Client{Transport: tr} User/password authentication dialSocksProxy := socks.Dial("socks5://user:[email protected]:1080?timeout=5s") Example package main import ( "fmt" "io/ioutil" "log" "net/http" "h12.io/socks" ) func main() { dialSocksProxy := socks.Dial("socks5://127.0.0.1:1080?timeout=5s") tr := &http.Transport{Dial: dialSocksProxy} httpClient := &http.Client{Transport: tr} resp, err := httpClient.Get("http://www.google.com") if err != nil { log.Fatal(err) } defer resp.Body.Close() if resp.StatusCode != http.StatusOK { log.Fatal(resp.StatusCode) } buf, err := ioutil.ReadAll(resp.Body) if err != nil { log.Fatal(err) } fmt.Println(string(buf)) }