Docs
ukafka
Kafka Connector
Quick Start

Quick Start

This example illustrates UKafka data synchronization to UHadoop.

Create Connector

1. Click the【Create Connector】button to open the configuration page

2. Configure the Connector

Fill in the necessary basic information as per need.

【Upstream】means the Kafka cluster upstream of the Kafka connector, and 【Downstream】means where the Kafka connector transports the data.

If 【Downstream】is HDFS, you need to configure the path; if it is Elasticsearch, you need to fill in the Index information.

In this example, the upstream is a UKafka cluster, the downstream is a UHadoop cluster, and the target HDFS path is /test/kafkaSinker.

Once the connector is created, you can view a summary of its properties in the list and manage more in the details page.

3. Data Verification

  • Create a Topic in the UKafka cluster: “for-sinker-test”, refer to: Topic Creation

  • Write messages to the Topic, refer to: Command Line Tools

  • Log in to the master1 node of UHadoop and check the files in HDFS

hadoop fs -ls /test/kafkaSinker/2019-07-21/
  • Check whether the text content is the same as what you entered in UKafka:
hadoop fs -text /test/kafkaSinker/2019-07-21/for-sinker-test-1.1563728241834.gz.tmp
Product IntroductionProduct Features