Crawl specific sites for job postings of data scientists and store and analyze them
golang v1.5
- Visit google, facebook, linkedin career pages
- Search for term: "data science"
- Follow links and create database of unigrams, bigrams and trigrams
- Create a database of languages and qualifications that companies care about
- Track how many postings per company
- What is the % of data scientist as a % of overall employees
- What are the most desired skills in a data scientist
export GOPATH=$PWD/go
go get golang.org/x/net/html
export PATH=$PATH:$PWD/go/bin
go install findlinks
findlinks https://golang.org