AWS RedShift

Luden supports Redshift as a destination. For more information about Redshift see docs. Redshift destination can work in stream and batch modes. In stream mode Luden uses plain insert statements for storing data. In batch mode Luden writes incoming events in formatted file on the AWS S3 and uses COPY command to store data from AWS S3 files into Redshift.

Configuration

Redshift destination config consists of the following schema:

destinations:
  my_redshift:
    type: redshift
    datasource:
      host: redshift.amazonaws.com
      db: my-db
      port: 5439
      schema: myschema
      username: user
      password: pass
      parameters:
        connect_timeout: 300
    s3:
      access_key_id: abc123
      secret_access_key: secretabc123
      bucket: my-bucket
      region: us-west-1
      folder: my_redshift