So Kotaku UK does not have an RSS feed right now. And as I'm still teaching myself Go, I figured it would be a fun small project to hack together a small scraper that serves up an RSS feed for my personal use.
git clone git@github.com:jimeh/kotaku-uk-rss.git
make build
bin/heroku-uk-rss --help
docker run -d --name kotaku-uk-rss -p 8080:8080 jimeh/kotaku-uk-rss
git clone git@github.com:jimeh/kotaku-uk-rss.git
cd kotaku-uk-rss
heroku create
git push heroku master
When launched, the process does two things:
- Starts a goroutine that will fetch a list of articles from the first 3 pages of kotaku.co.uk, and building and caching a RSS XML string from those articles. This is repeated every 60 seconds.
- Starts a web-server on
PORTnumber serving up cached RSS feed on/rss.
DO WHAT THE FUCK YOU WANT TO PUBLIC LICENSE
Version 2, December 2004
Copyright (C) 2014 Jim Myhrberg
Everyone is permitted to copy and distribute verbatim or modified
copies of this license document, and changing it is allowed as long
as the name is changed.
DO WHAT THE FUCK YOU WANT TO PUBLIC LICENSE
TERMS AND CONDITIONS FOR COPYING, DISTRIBUTION AND MODIFICATION
0. You just DO WHAT THE FUCK YOU WANT TO.