Set up tasks for the Snowflake High Performance connector for Kafka¶
This topic describes the overall tasks required to set up, configure, and run the Snowflake High Performance connector for Kafka.
Prerequisites¶
Ensure the following prerequisites are met:
Ensure that you have reviewed Snowflake High Performance connector for Kafka.
Ensure that you have reviewed how the connector works.
You are running Kafka Connect API 3.9.0 or earlier . Newer versions of Kafka Connect API are untested and may not be compatible with the connector. . Versions prior to 3.9.0 are compatible with the connector. For more information, see Kafka Compatibility (https://kafka.apache.org/protocol.html#protocol_compatibility).
You have configured Kafka with the desired data retention time and/or storage limit. See Snowflake High Performance connector for Kafka: Configure Kafka for all supported properties.
You have an install and configured the Kafka Connect cluster. . Snowflake recommends using the same versions on Kafka Broker and Kafka Connect Runtime.
You have configured the Kafka Connect cluster to run in the same cloud provider region as your Snowflake account.:newline:
.Snowflake strongly recommends running your Kafka Connect instance in the same cloud provider region as your Snowflake account. . While not strictly required, running in the same region typically improves throughput.:newline:.As such, Snowflake strongly recommend running your Kafka Connect instance in the same cloud provider region as your Snowflake account.
Tasks¶
Perform the following tasks to set up, configure, and run the Snowflake High Performance connector for Kafka.
Order |
Task |
Description |
|---|---|---|
0 |
Review Prerequisites |
Review and confirm all required prerequisites. |
1 |
Configure Snowflake for the Snowflake High Performance connector for Kafka. |
|
2 |
Configure Kafka for the Snowflake High Performance connector for Kafka. |
|
3 |
Test the connector with a small amount of data. |