Redshift (Destination)
Install
See the Install guide for the full setup, including Windows PowerShell.
curl -fsSL https://install.skippr.io/install.sh | shClick to copyLoads data into Amazon Redshift using a staging location in S3 (COPY workflow).
Configuration
yaml
warehouse:
kind: redshift
database: analytics
cluster_identifier: my-cluster
schema: public
region: us-east-1
staging_s3_bucket: my-load-bucket
staging_s3_prefix: "skippr/staging/"
iam_role_arn: "arn:aws:iam::123456789012:role/RedshiftS3Role"| Field | Default | Description |
|---|---|---|
database | (required) | Redshift database name |
schema | public | Target schema |
cluster_identifier | Provisioned cluster identifier | |
workgroup_name | Serverless workgroup (alternative to cluster) | |
db_user | Database user for COPY | |
region | AWS region | |
staging_s3_bucket | S3 bucket for staging files before COPY | |
staging_s3_prefix | Prefix inside the staging bucket | |
iam_role_arn | IAM role Redshift uses to read from S3 |
CLI
bash
skippr connect warehouse redshift \
--database analytics \
--cluster-identifier my-cluster \
--db-user admin \
--schema public \
--region us-east-1 \
--staging-s3-bucket my-load-bucket \
--staging-s3-prefix skippr/staging/ \
--iam-role-arn arn:aws:iam::123456789012:role/RedshiftS3Role| Flag | Description |
|---|---|
--database | Redshift database name |
--cluster-identifier | Provisioned cluster ID (use this or --workgroup-name) |
--workgroup-name | Serverless workgroup name (use this or --cluster-identifier) |
--db-user | Database user (provisioned clusters) |
--schema | Target schema (default: public) |
--region | AWS region |
--staging-s3-bucket | S3 bucket for COPY staging files |
--staging-s3-prefix | Prefix inside the staging bucket |
--iam-role-arn | IAM role Redshift uses to read from S3 |
Authentication
Authentication uses the AWS default credential chain.
AWS_ACCESS_KEY_IDandAWS_SECRET_ACCESS_KEY- IAM roles, instance profiles, or task roles
- AWS SSO or shared config profiles
Permissions or Network Requirements
The AWS principal must be able to use the Redshift API resources you reference, and Redshift must be able to read from the configured staging S3 bucket through iam_role_arn. The database user also needs write access to the target schema.
Troubleshooting
| Symptom | Fix |
|---|---|
| COPY or staging errors | Verify the staging S3 bucket, IAM role ARN, region, and Redshift cluster or workgroup settings. |
| permission denied | Check the Redshift database user, schema permissions, and the IAM role Redshift uses to read from S3. |
CDC Support
Redshift supports CDC with exactly-once final-state reconciliation via staging-table MERGE semantics. Skippr automatically creates _skippr_order_token columns and tombstone tables.
See CDC Destinations -- Redshift for details.
Next steps
- Pair this destination with a source from Source Connectors.
- For CDC semantics, see CDC Destinations, CDC Guarantees, and CDC Operations.
Install
See the Install guide for the full setup, including Windows PowerShell.
curl -fsSL https://install.skippr.io/install.sh | shClick to copy