Google Bigtable

Load event data into Google Bigtable for high-throughput, low-latency NoSQL storage at massive scale.

Configuration

FieldTypeRequiredDescription
project_idstringYesThe Google Cloud project ID that contains the Bigtable instance.
instance_idstringYesThe Bigtable instance ID.
table_idstringYesThe Bigtable table ID to write rows into.
column_familystringYesThe column family to write data to. Defaults to events.
service_account_jsonsecretYesThe full JSON key file content for a GCP service account with Bigtable User role.

Quick Setup

  1. Navigate to Integrations in the sidebar.
  2. Open the Integration Library tab.
  3. Find Google Bigtable or filter by Cloud Storage.
  4. Click Install, select a variant if available, and fill in the required fields.
  5. Click Install Integration to create the integration with a ready-to-use default configuration.

API Setup

curl -X POST http://localhost:8084/v1/admin/integration-catalog/google_bigtable/install \
  -H "Authorization: Bearer YOUR_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "name": "Google Bigtable",
    "variant": "default",
    "config": {
      "project_id": "my-gcp-project",
      "instance_id": "my-bigtable-instance",
      "table_id": "events",
      "column_family": "events"
    },
    "delivery_mode": "server_side"
  }'

Delivery

Events are delivered server-side from your Datafly Signal infrastructure directly to Google Bigtable. No client-side scripts are loaded for this integration.

Visit Google Bigtable documentation for full API documentation and credential setup instructions.