Datadog

This connector captures data from Datadog into Flow collections.

It is available for use in the Flow web application. For local development or open-source workflows, ghcr.io/estuary/source-datadog:dev provides the latest version of the connector as a Docker image. You can also follow the link in your browser to see past image versions.

Supported data resources

The following data resources are supported through the Datadog API:

• real_user_monitoring
• logs

By default, each resource is mapped to a Flow collection through a separate binding.

Prerequisites

• A Datadog account.

• A Datadog API key and Application key with the proper permissions:

  • rum_apps_read permission for RUM data
  • logs_read_data permission for logs data

  See Datadog's documentation for instructions on generating these credentials.

Configuration

You configure connectors either in the Flow web app, or by directly editing the catalog specification files. See connectors to learn more about using connectors. The values and specification sample below provide configuration details specific to the Datadog source connector.

Properties

Endpoint

Property	Title	Description	Type	Required/Default
/credentials/access_token	API Key	Datadog API Key.	string	Required
/credentials/application_key	Application Key	Datadog Application Key with rum_apps_read permissions.	string	Required
/credentials/credentials_title	Authentication Method	Set to Private App Credentials.	string	Required
/site	Site	The cloud region where the Datadog organization is deployed. Datadog's sites can be found here.	string	Required
/start_date	Start Date	The date that we should attempt to start backfilling from. If not provided, will use Datadog's 30-day RUM retention period.	date	Not Required
/advanced/logs_query	Log Query Filter	Query string to filter logs captured from Datadog. Uses Datadog's log search syntax described in their documentation. If not provided, all logs will be captured.	string	Not Required
/advanced/window_size	Window size	Window size in days for incrementals streams. Typically left as the default unless more frequent checkpoints are desired.	integer	30

Bindings

Property	Title	Description	Type	Required/Default
/name	Data resource	Name of the data resource.	string	Required
/interval	Interval	Interval between data syncs	string

Sample

captures:
  ${PREFIX}/${CAPTURE_NAME}:
    endpoint:
      connector:
        image: ghcr.io/estuary/source-datadog:dev
        config:
          credentials:
            credentials_title: Private App Credentials
            access_token: <secret>
            application_key: <secret>
          site: us5.datadoghq.com
    bindings:
      - resource:
          name: real_user_monitoring
        target: ${PREFIX}/real_user_monitoring
      - resource:
          name: logs
        target: ${PREFIX}/logs