Skip to content

Latest commit

 

History

History
97 lines (65 loc) · 2.33 KB

Druid.md

File metadata and controls

97 lines (65 loc) · 2.33 KB
Raw

Druid

Sink plugin: Druid [Flink]

Description

Write data to Apache Druid.

Options

name type required default value
coordinator_url String yes -
datasource String yes -
timestamp_column String no timestamp
timestamp_format String no auto
timestamp_missing_value String no -
parallelism Int no -

coordinator_url [String]

The URL of Coordinator service in Apache Druid.

datasource [String]

The DataSource name in Apache Druid.

timestamp_column [String]

The timestamp column name in Apache Druid, the default value is timestamp.

timestamp_format [String]

The timestamp format in Apache Druid, the default value is auto, it could be:

  • iso

    • ISO8601 with 'T' separator, like "2000-01-01T01:02:03.456"

  • posix

    • seconds since epoch

  • millis

    • milliseconds since epoch

  • micro

    • microseconds since epoch

  • nano

    • nanoseconds since epoch

  • auto

    • automatically detects ISO (either 'T' or space separator) or millis format

  • any Joda DateTimeFormat string

timestamp_missing_value [String]

The timestamp missing value in Apache Druid, which is used for input records that have a null or missing timestamp. The value of timestamp_missing_value should be in ISO 8601 format, for example "2022-02-02T02:02:02.222".

parallelism [Int]

The parallelism of an individual operator, for DruidSink

Example

Simple

DruidSink {
  coordinator_url = "http://localhost:8081/"
  datasource = "wikipedia"
}

Specified timestamp column and format

DruidSink {
  coordinator_url = "http://localhost:8081/"
  datasource = "wikipedia"
  timestamp_column = "timestamp"
  timestamp_format = "auto"
}

Specified timestamp column, format and missing value

DruidSink {
  coordinator_url = "http://localhost:8081/"
  datasource = "wikipedia"
  timestamp_column = "timestamp"
  timestamp_format = "auto"
  timestamp_missing_value = "2022-02-02T02:02:02.222"
}