Amazon Kinesis Manager

Data from Amazon Kinesis, which is used by the connector calculation functions to calculate values to be presented on wallboards, is collected by the Amazon Kinesis Manager. Depending on the connector configuration either Classic or Enhanced Fanout mode will be used for data collection.

Classic

Data collection uses the following requests:

  • List Shards

  • Get Shard Iterator

  • Get Records

Request Details

List Shards

API Endpoint: /
X-Amz-Target: Kinesis_20131202.ListShards
HTTP Verb: POST
Number of Requests: 1

Get Shard Iterator

API Endpoint: /
X-Amz-Target: Kinesis_20131202.GetShardIterator
HTTP Verb: POST
Number of Requests: 1 per Shard

Shard iterators returned by the API remain valid and in use for 5 minutes.

Get Records

API Endpoint: /
X-Amz-Target: Kinesis_20131202.GetRecords
HTTP Verb: POST
Number of Requests: Highly variable, depends on the amount of unread data in the stream.

These requests are rate limited to 5 requests per second.

Enhanced Fanout

Data collection uses the following requests:

  • List Stream Consumers

  • Register Stream Consumer

  • List Shards

  • Subscribe to Shard

  • Deregister Stream Consumer

Request Details

List Stream Consumers

API Endpoint: /
X-Amz-Target: Kinesis_20131202.ListStreamConsumers
HTTP Verb: POST
Number of Requests: 1

This request is made only once when the connector starts.

Register Stream Consumer

API Endpoint: /
X-Amz-Target: Kinesis_20131202.RegisterStreamConsumer
HTTP Verb: POST
Number of Requests: 1

This request is made only once when the connector starts.

List Shards

API Endpoint: /
X-Amz-Target: Kinesis_20131202.ListShards
HTTP Verb: POST
Number of Requests: 1

Subscribe to Shard

API Endpoint: /
X-Amz-Target: Kinesis_20131202.SubscribeToShard
HTTP Verb: POST
Number of Requests: 1 per Shard

These requests establish HTTP/2 connection for 5 minutes.

Deregister Stream Consumer

API Endpoint: /
X-Amz-Target: Kinesis_20131202.DeregisterStreamConsumer
HTTP Verb: POST
Number of Requests: 1

This request is made only once when the connector is shutting down.