Skip to main content

Google Cloud Storage Connector

Google Cloud Storage Manage files in a Google Cloud Platform (GCP) Cloud Storage bucket

Connections

Google Cloud Storage Private Key

Authenticate requests to Google Cloud Storage using a Private Key

To authenticate with Google Cloud Storage, a service account with a private key is required.

For more information on creating service accounts, refer to Google Cloud's authentication documentation.

Prerequisites

  • Access to a Google Cloud Platform (GCP) project
  • Permissions to create service accounts and assign roles

Setup Steps

To create a service account and generate a private key:

  1. Navigate to the Service Accounts page in the Google Cloud Console
  2. Select a project or create a new one
  3. Click Create Service Account
  4. Enter a service account name and description, then click Create and Continue
  5. Assign the appropriate role:
    • For full access to Cloud Storage: Select Cloud Storage Admin
    • For specific permissions: Select a resource-specific role based on requirements
  6. Click Continue, then Done
  7. In the service accounts list, click on the newly created service account
  8. Navigate to the Keys tab
  9. Click Add Key and select Create new key
  10. Select JSON as the key type and click Create
  11. A JSON file will be downloaded containing the service account credentials

Configure the Connection

The downloaded JSON file contains several fields including type, project_id, private_key, client_email, and others.

Enter the following values from the JSON file into the connection configuration:

  • Extract the required fields from the JSON file
  • Enter the Project ID (GCP Project ID)
  • Enter the service account credentials from the JSON file
Service Account Permissions

Ensure the service account has the appropriate permissions to access the Cloud Storage resources needed for the integration. Resource-specific permissions can be used for more granular access control.

InputCommentsDefault
Client EmailThe service account email address from the JSON key file.
Private KeyThe private key from the JSON key file. Include the entire key including BEGIN and END markers.
Project IDThe ID of the Google Cloud Platform project that hosts the storage bucket.

Google OAuth 2.0

Authenticate requests to Google Cloud Storage using Google OAuth 2.0

This connection uses OAuth 2.0, a common authentication mechanism for integrations. Read about how OAuth 2.0 works here.

InputCommentsDefault
ScopesOAuth scopes for Google Cloud Storage. See https://developers.google.com/identity/protocols/oauth2/scopes#storage for available scopes.https://www.googleapis.com/auth/devstorage.read_write
Client IDThe Client ID from the Google Cloud Console OAuth credentials.
Client SecretThe Client Secret from the Google Cloud Console OAuth credentials.
Project IDThe ID of the Google Cloud Platform project that hosts the storage bucket.

Actions

Complete Multipart Upload

Completes a multipart upload for a file in Google Cloud Storage

InputCommentsDefault
Part UploadsA JSON array of part uploads. Each part must have a partNumber and etag property. Note: Parts less than 5 MiB that are not the final part will result in a 400 Bad Request error.
File NameThe file path within the bucket. Do not include a leading slash.
Upload IDThe unique identifier for the multipart upload. This value is returned when the multipart upload is initiated.
Destination BucketThe name of the bucket where the file will be copied. When copying files within a single bucket, use the same bucket name for both source and destination.
Connection

Copy Files

Copy a file from one Google Cloud Storage bucket to another

InputCommentsDefault
Source BucketThe name of the bucket containing the file to copy. When copying files within a single bucket, use the same bucket name for both source and destination.
Destination BucketThe name of the bucket where the file will be copied. When copying files within a single bucket, use the same bucket name for both source and destination.
Source File NameThe source file path within the bucket. Do not include a leading slash.
Destination File NameThe destination file path within the bucket. Do not include a leading slash.
Connection

Create Bucket

Create a new Bucket inside Google Cloud Storage

InputCommentsDefault
Connection
Bucket NameThe name of the Google Cloud Storage bucket. Bucket names contain only lowercase letters, numbers, hyphens, and underscores.
Multi-RegionalWhen true, the bucket will be available from multiple regions.false
User ProjectThe project ID that the user creating the bucket belongs to.
LocationThe geographic location where the bucket will be created. Defaults to 'US'. See https://cloud.google.com/storage/docs/locations for available locations.
Storage ClassThe storage class for the bucket. See https://cloud.google.com/storage/docs/storage-classes for details.

Create Multipart Upload

Create a multipart upload for a file in Google Cloud Storage

InputCommentsDefault
File NameThe file path within the bucket. Do not include a leading slash.
Content TypeThe MIME type of the file (e.g., image/png, application/pdf, text/plain).
Destination BucketThe name of the bucket where the file will be copied. When copying files within a single bucket, use the same bucket name for both source and destination.
Connection

Delete Bucket

Delete an existing Bucket from the Google Cloud Storage

InputCommentsDefault
Bucket NameThe name of the Google Cloud Storage bucket. Bucket names contain only lowercase letters, numbers, hyphens, and underscores.
Connection

Delete File

Delete a file from a Google Cloud Storage bucket

InputCommentsDefault
File NameThe file path within the bucket. Do not include a leading slash.
Bucket NameThe name of the Google Cloud Storage bucket. Bucket names contain only lowercase letters, numbers, hyphens, and underscores.
Connection

Download File

Download a file from Google Cloud Storage

InputCommentsDefault
File NameThe file path within the bucket. Do not include a leading slash.
Bucket NameThe name of the Google Cloud Storage bucket. Bucket names contain only lowercase letters, numbers, hyphens, and underscores.
Connection

Generate Presigned URL

Generate a presigned URL to upload a file in Google Cloud Storage

InputCommentsDefault
Connection
File NameThe file name to generate a presigned URL for. This should be the full file name, including any directories. For example, my-directory/my-file.txt
Bucket NameThe name of the Google Cloud Storage bucket. Bucket names contain only lowercase letters, numbers, hyphens, and underscores.
Expiration TimeThe expiration time for the presigned URL in seconds. Defaults to 3600 (1 hour).3600

Get Bucket

Get the information and metadata of an existing Bucket from the Google Cloud Storage

InputCommentsDefault
Bucket NameThe name of the Google Cloud Storage bucket. Bucket names contain only lowercase letters, numbers, hyphens, and underscores.
Connection

Get File

Get the information and metadata of a file from Google Cloud Storage

InputCommentsDefault
File NameThe file path within the bucket. Do not include a leading slash.
Bucket NameThe name of the Google Cloud Storage bucket. Bucket names contain only lowercase letters, numbers, hyphens, and underscores.
Connection

List Buckets

List buckets in a Google Cloud Storage project

InputCommentsDefault
Fetch All ResultsWhen true, automatically fetches all pages of results using pagination.false
Connection

List Files

List files in a Google Cloud Storage bucket

InputCommentsDefault
Connection
Bucket NameThe name of the Google Cloud Storage bucket. Bucket names contain only lowercase letters, numbers, hyphens, and underscores.
PrefixFilter results to only files with names starting with this prefix. For example, 'unprocessed/' returns only files in that directory. Leave blank to list all files.
Page TokenThe pagination token returned by a previous request. Use this to retrieve the next page of results.
Max ResultsThe maximum number of results to return per page. Must be between 1 and 50.
Fetch All ResultsWhen true, automatically fetches all pages of results using pagination.false

Move File

Move a file from one Google Cloud Storage bucket to another

InputCommentsDefault
Source BucketThe name of the bucket containing the file to copy. When copying files within a single bucket, use the same bucket name for both source and destination.
Destination BucketThe name of the bucket where the file will be copied. When copying files within a single bucket, use the same bucket name for both source and destination.
Source File NameThe source file path within the bucket. Do not include a leading slash.
Destination File NameThe destination file path within the bucket. Do not include a leading slash.
Connection

Raw Request

Send raw HTTP request to Google Cloud Storage

InputCommentsDefault
Connection
URLInput the path only (/storage/v1/b/[BUCKET_NAME]/o/[OBJECT_NAME]), The base URL is already included (https://storage.googleapis.com).
MethodThe HTTP method to use.
DataThe HTTP body payload to send to the URL.
Form DataThe Form Data to be sent as a multipart form upload.
File DataFile Data to be sent as a multipart form upload.
File Data File NamesFile names to apply to the file data inputs. Keys must match the file data keys above.
Query ParameterA list of query parameters to send with the request. This is the portion at the end of the URL similar to ?key1=value1&key2=value2.
HeaderA list of headers to send with the request.
Response TypeThe type of data you expect in the response. You can request json, text, or binary data.json
TimeoutThe maximum time that a client will await a response to its request
Retry Delay (ms)The delay in milliseconds between retries. This is used when 'Use Exponential Backoff' is disabled.0
Retry On All ErrorsIf true, retries on all erroneous responses regardless of type. This is helpful when retrying after HTTP 429 or other 3xx or 4xx errors. Otherwise, only retries on HTTP 5xx and network errors.false
Max Retry CountThe maximum number of retries to attempt. Specify 0 for no retries.0
Use Exponential BackoffSpecifies whether to use a pre-defined exponential backoff strategy for retries. When enabled, 'Retry Delay (ms)' is ignored.false

Save File

Save a file to Google Cloud Storage

InputCommentsDefault
File ContentsThe contents to write to a file. This can be a string of text, it can be binary data (like an image or PDF) that was generated in a previous step.
File NameThe file path within the bucket. Do not include a leading slash.
Bucket NameThe name of the Google Cloud Storage bucket. Bucket names contain only lowercase letters, numbers, hyphens, and underscores.
File MetadataWhen true, returns the file metadata after saving. Read access to the bucket is required.true
Connection

Upload Part of a Multipart Upload

Upload a part of a multipart upload to Google Cloud Storage

InputCommentsDefault
Upload IDThe unique identifier for the multipart upload. This value is returned when the multipart upload is initiated.
File NameThe file path within the bucket. Do not include a leading slash.
File ContentsThe contents to write to a file. This can be a string of text, it can be binary data (like an image or PDF) that was generated in a previous step.
Part NumberThe position of this part within the multipart upload. Must be an integer between 1 and 10,000.
Destination BucketThe name of the bucket where the file will be copied. When copying files within a single bucket, use the same bucket name for both source and destination.
Connection