Kinesis
Install
See the Install guide for the full setup, including Windows PowerShell.
curl -fsSL https://install.skippr.io/install.sh | shClick to copyConsumes records from an Amazon Kinesis stream.
Configuration
yaml
source:
kind: kinesis
stream_name: my-stream
region: us-east-1| Field | Default | Description |
|---|---|---|
stream_name | (required) | Kinesis stream name |
region | AWS region | |
endpoint_url | Custom Kinesis endpoint URL | |
mode | Consumption mode such as stream or batch |
CLI
bash
skippr connect source kinesis \
--stream-name my-stream \
--region us-east-1 \
--endpoint-url http://localhost:4566 \
--mode stream| Flag | Description |
|---|---|
--stream-name | Kinesis stream name |
--region | AWS region |
--endpoint-url | Custom Kinesis endpoint URL |
--mode | Consumption mode |
Authentication
Authentication uses the AWS default credential chain.
AWS_ACCESS_KEY_IDandAWS_SECRET_ACCESS_KEY- IAM roles, instance profiles, or task roles
- AWS SSO or shared config profiles
Permissions or Network Requirements
The AWS principal needs kinesis:DescribeStreamSummary, kinesis:GetShardIterator, and kinesis:GetRecords on the selected stream. The runner must also be able to reach the regional Kinesis endpoint.
Troubleshooting
| Symptom | Fix |
|---|---|
| AccessDenied or stream errors | Verify the AWS credential chain, stream name, region, and Kinesis permissions. |
| no records arriving | Check that producers are writing to the expected stream and shard activity is present. |
Next steps
- Pair this source with a destination from Destination Connectors.
- See How It Works for the end-to-end pipeline flow.
Install
See the Install guide for the full setup, including Windows PowerShell.
curl -fsSL https://install.skippr.io/install.sh | shClick to copy