Luden
GuinsooLabGitHub
  • Welcome to Luden!
  • Quickstart
    • Deploying with Docker
    • Building from Source
    • Scaling Luden Server
  • Configuration
    • Configuration
    • Authorization
    • Destinations Conf
      • Snowflake
      • AWS S3
      • AWS RedShift
      • Postgres
      • Google BigQuery
      • MySQL
      • Clickhouse
      • Guinsoo
      • WebHook
    • Sources Conf
      • Synchronization Scheduling
      • Airbyte Based Sources
    • Sources Catelog
  • Features
    • JavaScript Transform
    • Destination Tags
    • Data Warehouses
    • Match Mode
    • Stream Mode
    • DBT Cloud Integration
    • Event Cache
    • Geo Data Resolution
    • Typecast
    • Admin Endpoint
    • Application Metrics
  • Sending Data
    • JS SDK
    • Node.js
    • Event API
    • Bulk API
    • Segment API
  • Extending
    • Destination Extensions
    • Source Extensions
    • API Specs
    • Luden Architecture
  • Appendix
    • Contribute
    • FAQs
Powered by GitBook
On this page
  • Configuration
  • Supported Events
  1. Features

DBT Cloud Integration

PreviousStream ModeNextEvent Cache

Last updated 2 years ago

You can configure Jitsu to trigger on certain events:

  • Successful run of Source sync task

  • Sync of Destination in batch mode

Configuration

To enable the integration first you need to configure a special kind of destination with type dbtcloud:

destinations:
 my_dbtcloud:
  type: dbtcloud
  mode: stream
  dbtcloud:
   account_id: 12345
   job_id: 12345
   cause: '`${_.event_type} triggered sync. source: ${_.source}`'
   token: '12345'
   enabled: true

Then you need to add this destination to post_handle_destinations collection of Sources and Destinations that need to trigger dbt Cloud job:

sources:
  amplitude:
    type: amplitude
    post_handle_destinations:
      - my_dbtcloud
    config:
    ...
destinations:
 my_snowflake:
  type: snowflake
  mode: batch
  post_handle_destinations:
   - my_dbtcloud
  snowflake:
  ...

Supported Events

dbt Cloud destination works with following event types only:

  • SOURCE_SUCCESSFUL_RUN

  • DESTINATION_BATCH_RUN

all other events are ignored.

Event body example:

{
    "event_type":  "DESTINATION_BATCH_RUN",
    "source":      "my_snowflake",
    "_timestamp":  "2021-08-05T14:33:18.607892Z",
    "finished_at": "2021-08-05T14:33:18.607892Z",
    "started_at":  "2021-08-05T14:30:55.182912Z"
}
dbt Cloud job run