Google Cloud Storage file system support#

Trino includes a native implementation to access Google Cloud Storage (GCS) with a catalog using the Delta Lake, Hive, Hudi, or Iceberg connectors.

Enable the native implementation with fs.native-gcs.enabled=true in your catalog properties file.

General configuration#

Use the following properties to configure general aspects of Google Cloud Storage file system support:

Property

Description

fs.native-gcs.enabled

Activate the native implementation for Google Cloud Storage support. Defaults to false. Set to true to use Google Cloud Storage and enable all other properties.

gcs.project-id

Identifier for the project on Google Cloud Storage.

gcs.client.max-retries

Maximum number of RPC attempts. Defaults to 20.

gcs.client.backoff-scale-factor

Scale factor for RPC retry delays. Defaults to 3.

gcs.client.max-retry-time

Total time duration limit for RPC call retries. Defaults to 25s.

gcs.client.min-backoff-delay

Minimum delay duration between RPC retries. Defaults to 10ms.

gcs.client.max-backoff-delay

Maximum delay duration between RPC retries. Defaults to 2s.

gcs.read-block-size

Minimum data size for blocks read per RPC. Defaults to 2MiB. See com.google.cloud.BaseStorageReadChannel.

gcs.write-block-size

Minimum data size for blocks written per RPC. The Defaults to 16MiB. See com.google.cloud.BaseStorageWriteChannel.

gcs.page-size

Maximum number of blobs to return per page. Defaults to 100.

gcs.batch-size

Number of blobs to delete per batch. Defaults to 100. Recommended batch size is 100.

gcs.application-id

Specify the application identifier appended to the User-Agent header for all requests sent to Google Cloud Storage. Defaults to Trino.

Authentication#

Use one of the following properties to configure the authentication to Google Cloud Storage:

Property

Description

gcs.use-access-token

Flag to set usage of a client-provided OAuth 2.0 token to access Google Cloud Storage. Defaults to false.

gcs.json-key

Your Google Cloud service account key in JSON format. Not to be set together with gcs.json-key-file-path.

gcs.json-key-file-path

Path to the JSON file on each node that contains your Google Cloud Platform service account key. Not to be set together with gcs.json-key.