Skip to main content

Connections (Dagster+)

Dagster+ feature

This feature is only available in Dagster+.

Connections allow you to easily discover and sync data warehouse assets from sources like Snowflake, BigQuery, Postgres, and Databricks into Dagster. These assets are viewable in the Dagster UI catalog, and you can set alerts on schema changes or metadata values (like row count).

Supported data warehouses

Connections currently supports the following data warehouse types, which each have their own configuration guide:

Monitoring Connections assets with alerts

You can use alerts to monitor two kinds of changes to your Connections assets: schema changes, or metadata changes.

  1. Navigate to Deployment > Alerts and click Create alert policy.
  2. Select Asset as the alert type.
  3. Set the target to a "Custom Selection" with group: NAME_OF_YOUR_CONNECTION.
  4. Then select Table schema changes or Metrics as the event type, and complete the rest of the configuration.

About the asset definitions created from Connections

The assets created by a Connection are independent from existing Dagster definitions, and use the name of your Connection as both the group name and code location name.

Currently, metadata on assets from Connections does not impact code-defined assets, even if they point to the same underlying data warehouse table (though this may change in the future).