Skip to content

paybyphone/kinchan

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

AWS Kinesis Channels

Makes Kinesis streams look like Go channels.

Usage:

package main

import (
	"fmt"
	"log"

	"github.com/paybyphone/kinchan"
)

func main() {
	awsKinesisStreamName := "MyStreamName"
	awsKinesisShardIteratorType := "LATEST"
	awsRegion := "us-west-2"

	shards, err := kinchan.GetShards(awsKinesisStreamName, awsRegion)
	if err != nil {
		log.Fatal(err)
	}

	messageChannel := make(chan []byte, 1000)
	for _, shard := range shards {
		go kinchan.Consume(shard, awsKinesisStreamName, awsKinesisShardIteratorType, messageChannel)
	}

	go logMessagesToConsole(messageChannel)

	waitForever := make(chan string)
	waitForever <- ""
}

func logMessagesToConsole(messageChannel chan []byte) {
	for {
		data := <-messageChannel
		fmt.Println(string(data))
	}
}

Caveats

  • Consumer only.
  • No reliable consumer implementation.
  • No automatic resharding.

About

Makes AWS Kinesis shards look like Go channels.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages