Skip to content

Redshift (Destination)

Install

See the Install guide for the full setup, including Windows PowerShell.

curl -fsSL https://install.skippr.io/install.sh | shClick to copy

Loads data into Amazon Redshift using a staging location in S3 (COPY workflow).

Configuration

yaml
warehouse:
  kind: redshift
  database: analytics
  cluster_identifier: my-cluster
  schema: public
  region: us-east-1
  staging_s3_bucket: my-load-bucket
  staging_s3_prefix: "skippr/staging/"
  iam_role_arn: "arn:aws:iam::123456789012:role/RedshiftS3Role"
FieldDefaultDescription
database(required)Redshift database name
schemapublicTarget schema
cluster_identifierProvisioned cluster identifier
workgroup_nameServerless workgroup (alternative to cluster)
db_userDatabase user for COPY
regionAWS region
staging_s3_bucketS3 bucket for staging files before COPY
staging_s3_prefixPrefix inside the staging bucket
iam_role_arnIAM role Redshift uses to read from S3

CLI

bash
skippr connect warehouse redshift \
  --database analytics \
  --cluster-identifier my-cluster \
  --db-user admin \
  --schema public \
  --region us-east-1 \
  --staging-s3-bucket my-load-bucket \
  --staging-s3-prefix skippr/staging/ \
  --iam-role-arn arn:aws:iam::123456789012:role/RedshiftS3Role
FlagDescription
--databaseRedshift database name
--cluster-identifierProvisioned cluster ID (use this or --workgroup-name)
--workgroup-nameServerless workgroup name (use this or --cluster-identifier)
--db-userDatabase user (provisioned clusters)
--schemaTarget schema (default: public)
--regionAWS region
--staging-s3-bucketS3 bucket for COPY staging files
--staging-s3-prefixPrefix inside the staging bucket
--iam-role-arnIAM role Redshift uses to read from S3

Authentication

Authentication uses the AWS default credential chain.

  • AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY
  • IAM roles, instance profiles, or task roles
  • AWS SSO or shared config profiles

Permissions or Network Requirements

The AWS principal must be able to use the Redshift API resources you reference, and Redshift must be able to read from the configured staging S3 bucket through iam_role_arn. The database user also needs write access to the target schema.

Troubleshooting

SymptomFix
COPY or staging errorsVerify the staging S3 bucket, IAM role ARN, region, and Redshift cluster or workgroup settings.
permission deniedCheck the Redshift database user, schema permissions, and the IAM role Redshift uses to read from S3.

CDC Support

Redshift supports CDC with exactly-once final-state reconciliation via staging-table MERGE semantics. Skippr automatically creates _skippr_order_token columns and tombstone tables.

See CDC Destinations -- Redshift for details.

Next steps

Install

See the Install guide for the full setup, including Windows PowerShell.

curl -fsSL https://install.skippr.io/install.sh | shClick to copy