Hpipe

 _______         __
|   |   |.-----.|__|.-----.-----.
|       ||  _  ||  ||  _  |  -__|
|___|___||   __||__||   __|_____|
         |__|       |__|

Hpipe is a workflow engine supporting hybrid workflows with built-in support for Hadoop Streaming and Hive.

It is useful in many production scenarios such as offline data processing of click-through-rate prediction for online advertising.

Features

Integrate various types of jobs into a uniformed workflow.
Job status tracking mechanism: keep job status and auto-resume from breakpoints.
Workflow descriptive language based on Graphviz being easy to edit and visualize.

Name		Name	Last commit message	Last commit date
Latest commit History 353 Commits
config		config
dag		dag
dist		dist
docs		docs
examples		examples
exec		exec
log		log
sched		sched
status		status
storage		storage
util		util
.gitignore		.gitignore
.travis.yml		.travis.yml
LICENSE		LICENSE
Makefile		Makefile
README.md		README.md
TODO.md		TODO.md
ast_test.go		ast_test.go
dag_test.go		dag_test.go
eval_test.go		eval_test.go
hpipe.go		hpipe.go
log_test.go		log_test.go
symbol_test.go		symbol_test.go
util_test.go		util_test.go