Google Cloud Storage
Install
See the Install guide for the full setup, including Windows PowerShell.
curl -fsSL https://install.skippr.io/install.sh | shClick to copyWrites Parquet files to a GCS bucket.
Configuration
warehouse:
kind: gcs
bucket: my-bucket
prefix: "data/"
service_account_key_path: ${GCS_SERVICE_ACCOUNT_KEY_PATH}| Field | Default | Description |
|---|---|---|
bucket | (required) | GCS bucket name |
prefix | Key prefix for uploaded objects | |
service_account_key_path | Path to service account JSON key |
Authentication
Authenticate with a Google Cloud service account key. For security best practices, we strongly advise against storing the service account key path in skippr.yaml. Use environment variable interpolation instead: replace the service_account_key_path value with your own ${ENV_VAR} reference.
The relevant part of skippr.yaml looks like this:
warehouse:
kind: gcs
service_account_key_path: ${GCS_SERVICE_ACCOUNT_KEY_PATH}Set the env var before running skippr:
macOS / Linux
export GCS_SERVICE_ACCOUNT_KEY_PATH="/path/to/key.json"Windows PowerShell
$env:GCS_SERVICE_ACCOUNT_KEY_PATH = "C:\path\to\key.json"Windows Command Prompt
set GCS_SERVICE_ACCOUNT_KEY_PATH=C:\path\to\key.jsonPermissions or Network Requirements
The service account needs permission to create objects in the target bucket and prefix. The runner must also be able to reach Google Cloud Storage from the network where it runs.
Troubleshooting
| Symptom | Fix |
|---|---|
| authentication failed | Verify the service account key path and confirm the key still belongs to an active service account. |
| writes fail | Check bucket permissions, object prefix settings, and any organization policies affecting the bucket. |
Next steps
- Pair this destination with a source from Source Connectors.
- See Quick Start for the recommended warehouse evaluation paths.
Install
See the Install guide for the full setup, including Windows PowerShell.
curl -fsSL https://install.skippr.io/install.sh | shClick to copy