Skip to main content

Datadog

This connector captures data from Datadog into Flow collections.

It is available for use in the Flow web application. For local development or open-source workflows, ghcr.io/estuary/source-datadog:dev provides the latest version of the connector as a Docker image. You can also follow the link in your browser to see past image versions.

Supported data resources

The following data resources are supported through the Datadog API:

By default, each resource is mapped to a Flow collection through a separate binding.

Prerequisites

  • A Datadog account.
  • A Datadog API key and Application key with rum_apps_read permission scope. See Datadog's documentation for instructions on generating these credentials.

Configuration

You configure connectors either in the Flow web app, or by directly editing the catalog specification files. See connectors to learn more about using connectors. The values and specification sample below provide configuration details specific to the Datadog source connector.

Properties

Endpoint

PropertyTitleDescriptionTypeRequired/Default
/credentials/access_tokenAPI KeyDatadog API Key.stringRequired
/credentials/application_keyApplication KeyDatadog Application Key with rum_apps_read permissions.stringRequired
/credentials/credentials_titleAuthentication MethodSet to Private App Credentials.stringRequired
/siteSiteThe cloud region where the Datadog organization is deployed. Datadog's sites can be found here.stringRequired
/start_dateStart DateThe date that we should attempt to start backfilling from. If not provided, will use Datadog's 30-day RUM retention period.dateNot Required
/advanced/window_sizeWindow sizeWindow size in days for incrementals streams. Typically left as the default unless more frequent checkpoints are desired.integer30

Bindings

PropertyTitleDescriptionTypeRequired/Default
/nameData resourceName of the data resource.stringRequired
/intervalIntervalInterval between data syncsstring

Sample

captures:
${PREFIX}/${CAPTURE_NAME}:
endpoint:
connector:
image: ghcr.io/estuary/source-datadog:dev
config:
credentials:
credentials_title: Private App Credentials
access_token: <secret>
application_key: <secret>
site: us5.datadoghq.com
bindings:
- resource:
name: real_user_monitoring
target: ${PREFIX}/real_user_monitoring
- resource:
name: logs
target: ${PREFIX}/logs