Export data to Google Cloud Storage
Automate recurring data exports from Stripe to your Google Cloud Storage.
Google Cloud Storage destination
Data pipeline can deliver all your Stripe data as Parquet files into your Google Cloud Storage (GCS) bucket. It includes a directory of files for each table, which is delivered and updated every 3 hours.
Loading video content...
Prerequisites
Before starting the integration, make sure you have access and permission to:
- Create a Google Cloud Storage bucket.
- Create a service account enabling Stripe to create objects in the provisioned bucket.
- Access the Stripe Dashboard as an admin.
Select Your Google Cloud Project
- Go to the Google Cloud Console .
- Select the project that you want to send your Stripe data to.
Create a new Service Account and generate a JSON key
- On the Service Accounts page, make sure you’re in the correct Google Cloud Project.
- Click + the related setting the related setting the related setting .
- Enter a name for the service account, for example, “<name>-stripe-data-pipeline.”
- Add a description—for example, “This role gives Stripe access to upload data files to our bucket.”
- Click the related setting AND the related setting .
- In the Select a Role dropdown, add three roles: Storage Object User , Storage Object Creator , and Storage Insights Collector Service .
- Click DONE .
- For your new Service Account , click Manage keys in the Actions menu.
- Click ADD KEY ▾ and select Create new key .
- Choose Key type JSON and click the related setting . The JSON file downloads to your device.
Create a New Bucket
- Make sure you’re in the correct Google Cloud project by navigating to Cloud Storage > Buckets in the Google Cloud console .
- Click + the related setting .
- In the Name field, include “stripe,” such as “<name>-stripe-data.”
- For the Location type , select Multi-Regional US .
- For the Storage class , select Set a default class - Standard .
- For the Access Control , choose Prevent public access with Uniform access control.
- Click the related setting button to create the bucket.
- Select the the related setting tab for your newly created bucket.
- Under Permissions in the VIEW BY the related setting tab, select the box next to the Service Account you created in the previous step.
Caution
Setting a retention policy on your bucket might cause the data exports to fail, because it restricts the ability to delete or override files in the bucket.
Optional Generate encryption keys
Establishing your Google Cloud Storage connection
- Visit the Data Pipeline Dashboard .
- Click Get started .
- Select the Google Cloud Storage logo and click Continue -> . This step generates a bucket name.
- Enter the bucket name generated in the previous step.
- Upload your Service Account . json file generated earlier.
- Select your data encryption option. If you chose to use a customer managed key, upload your public key.
- Click the Next button. Clicking this button sends test data to the bucket you provided, but not production data.
- When you confirm test data delivery, go to your Cloud Storage bucket .
- Open the bucket, go to the penny_test directory, and open the acct_ or org_ prefixed sub-directory to locate the delivered account _ validation. csv test file.
- Click the account_validation.csv file.
- Click the related setting .
- Click the Upload the test value file and upload the downloaded account _ validation. csv .
- Click Confirm value .
- When you confirm the test value, click Subscribe . This subscribes you to the product and schedules the initial full load of data for delivery to your Google Cloud Storage bucket, a process that can take 6-12 hours.
*Google Cloud Storage is a trademark of Google LLC.
