Clickhouse

Clickhouse source connector

Support Those Engines​

Spark
Flink
SeaTunnel Zeta

Key Features​

• batch
• stream
• exactly-once
• column projection
• parallelism
• support user-defined split

supports query SQL and can achieve projection effect.

Description​

Used to read data from Clickhouse.

Supported DataSource Info​

In order to use the Clickhouse connector, the following dependencies are required.They can be downloaded via install-plugin.sh or from the Maven central repository.

Data Type Mapping​

Source Options​

How to Create a Clickhouse Data Synchronization Jobs​

The following example demonstrates how to create a data synchronization job that reads data from Clickhouse and prints it on the local client:

# Set the basic configuration of the task to be performed
env{
  parallelism=10
  job.mode="BATCH"
}

# Create a source to connect to Clickhouse
source{
  Clickhouse{
host="localhost:8123"
    database="default"
    sql="select * from test where age = 20 limit 100"
    username="xxxxx"
    password="xxxxx"
    server_time_zone="UTC"
    plugin_output="test"
    clickhouse.config={
"socket_timeout":"300000"
}
}
}

# Console printing of the read Clickhouse data
sink{
  Console{
    parallelism=1
}
}

Tips​

1.SeaTunnel Deployment Document.