Azure Data Lake Storage Gen2

Load event data into Azure Data Lake Storage Gen2 for scalable, cost-effective data lake storage with hierarchical namespace.

Configuration

FieldTypeRequiredDescription
account_namestringYesThe Azure storage account name.
containerstringYesThe blob container name.
path_prefixstringNoThe path prefix for stored objects. Defaults to events/.
access_keysecretYesThe Azure storage account access key.

Quick Setup

  1. Navigate to Integrations in the sidebar.
  2. Open the Integration Library tab.
  3. Find Azure Data Lake Storage Gen2 or filter by Cloud Storage.
  4. Click Install, select a variant if available, and fill in the required fields.
  5. Click Install Integration to create the integration with a ready-to-use default configuration.

API Setup

curl -X POST http://localhost:8084/v1/admin/integration-catalog/azure_data_lake/install \
  -H "Authorization: Bearer YOUR_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "name": "Azure Data Lake Storage Gen2",
    "variant": "default",
    "config": {
      "account_name": "mystorageaccount",
      "container": "events",
      "path_prefix": "events/"
    },
    "delivery_mode": "server_side"
  }'

Delivery

Events are delivered server-side from your Datafly Signal infrastructure directly to Azure Data Lake Storage Gen2. No client-side scripts are loaded for this integration.

Visit Azure Data Lake Storage Gen2 documentation for full API documentation and credential setup instructions.