Skip to content

LLParse/chanarchive

 
 

Repository files navigation

ChanArchive

September 22, 2016

ChanArchive is a distributed api designed to archive the 4Chan API. It is built to run on Rancher. This is mostly an experiment to gather 4chan usage statistics, as well as load test the Etcd and Cassandra Rancher templates.

Overview

The infrastructure comprises four parts:

  • etcd, used for distributed locking
  • cassandra, a distributed NoSQL database
  • ChanArchive node, downloads the content from 4chan
  • ChanArchive api, serves the content to end users

Dependencies

  • etcd client
  • gocql
  • go-bindata (Optional: For development only: go get -u github.com/jteeuwen/go-bindata/... && go-bindata -o ./asset/bindata.go -pkg asset asset/...)

Building

If you have the appropriate dependecies, simply build with go build. Alternatively you can run ./version.sh to embed the build date and git hash into the build.

About

StreamingChan is a distributed api designed to create a "real-time" like endpoint for the 4Chan API.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Go 80.9%
  • HTML 17.2%
  • Shell 1.9%