Skip to content

Google Cloud Storage

Install

See the Install guide for the full setup, including Windows PowerShell.

curl -fsSL https://install.skippr.io/install.sh | shClick to copy

Writes Parquet files to a GCS bucket.

Configuration

yaml
warehouse:
  kind: gcs
  bucket: my-bucket
  prefix: "data/"
  service_account_key_path: ${GCS_SERVICE_ACCOUNT_KEY_PATH}
FieldDefaultDescription
bucket(required)GCS bucket name
prefixKey prefix for uploaded objects
service_account_key_pathPath to service account JSON key

Authentication

Authenticate with a Google Cloud service account key. For security best practices, we strongly advise against storing the service account key path in skippr.yaml. Use environment variable interpolation instead: replace the service_account_key_path value with your own ${ENV_VAR} reference.

The relevant part of skippr.yaml looks like this:

yaml
warehouse:
  kind: gcs
  service_account_key_path: ${GCS_SERVICE_ACCOUNT_KEY_PATH}

Set the env var before running skippr:

macOS / Linux

bash
export GCS_SERVICE_ACCOUNT_KEY_PATH="/path/to/key.json"

Windows PowerShell

powershell
$env:GCS_SERVICE_ACCOUNT_KEY_PATH = "C:\path\to\key.json"

Windows Command Prompt

cmd
set GCS_SERVICE_ACCOUNT_KEY_PATH=C:\path\to\key.json

Permissions or Network Requirements

The service account needs permission to create objects in the target bucket and prefix. The runner must also be able to reach Google Cloud Storage from the network where it runs.

Troubleshooting

SymptomFix
authentication failedVerify the service account key path and confirm the key still belongs to an active service account.
writes failCheck bucket permissions, object prefix settings, and any organization policies affecting the bucket.

Next steps

Install

See the Install guide for the full setup, including Windows PowerShell.

curl -fsSL https://install.skippr.io/install.sh | shClick to copy