Skip to content

erans/nsq-to-bigquery

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

nsq to bigquery logo

Build Status

nsq-to-bigquery

Stream NSQ messages to Google's BigQuery using the streaming API.

Written by Eran Sandler (@erans)

This is a very early version that does work but was not (yet) tested in real hard production environment.

Assumptions / Limitations:

  • Message body is a valid JSON that is a flat dictionary (only key and simple values).
  • Each message must contain data that will constitute a single row that will go into BigQuery.
  • BigQuery table MUST exists and the schema MUST match the JSON being sent.
  • This version sends each message in its own request and does not use any batch API (yet).

About

Stream NSQ messages to Google's BigQuery using the streaming API

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published