#downloader

This the downloader component in yascrapy project deleveped with golang.

To use core component, simply do

./core -config_file /etc/yascrapy/core.json -consumers 10 -crawler_name "sample_spider"

To use proxy component, simply do

./proxy -config_file /etc/yascrapy/proxy.json