Prerequisites for Snowflake Connector for MySQL

Important

Thank you for your interest in the Snowflake Connector for MySQL. We’re now focused on a next-generation solution that will offer a significantly improved experience; therefore, moving this connector to the general availability status is currently not on our product roadmap. You may continue to use this connector as preview feature, but please note that support for future bug fixes and improvements are not guaranteed. The new solution is available as Openflow Connector for MySQL and includes better performance, customizability, and enhanced deployment options.

Before installing the Snowflake Connector for MySQL, you must ensure that the following prerequisites are met in your MySQL and Snowflake environments.

设置 MySQL 的先决条件

Before installing the Openflow Connector for MySQL, do the following in your MySQL environment:

  • 确保您有一台 MySQL 8 服务器，其中包含您要与 Snowflake 同步的数据。

  • 为您的 MySQL 服务器设置以下选项：

    log_bin = on
binlog_format = row
binlog_row_metadata = full
binlog_row_image = full
binlog_row_value_options =

    Note

    Be cautious about the binary log expiration period (binlog_expire_logs_seconds). After it ends, binary log files might be automatically removed. If the agent is paused for a long period of time (for example due to maintenance work) and the expired binary log files are deleted during this time, the agent is not able to replicate the data from these files. Set the binary log expiration period to at least a few hours to ensure stable work of the connector.

    For more information about the automatic purging of binary log files, see MySQL Reference Manual (https://dev.mysql.com/doc/refman/8.0/en/replication-options-binary-log.html).

设置运行代理的先决条件

在安装连接器之前，您必须设置代理运行的环境。

配置防火墙以访问 Snowflake

If you are using a firewall, add the Snowflake hostnames and port numbers to the allowed list. For more information, see Allowing Host names.

After adding the hostnames and port numbers to the allowed list, use SnowCD to verify the Snowflake connection from the host where you run the agent.

安装编排工具

代理以 Docker 映像的形式分发，您可以使用 Docker、Kubernetes 或 OpenShift 等编排工具和服务运行该映像。

要运行代理，您必须安装这些工具之一。您的环境必须具有：

  • 运行代理的容器至少有 6 GB 可用的 RAM。代理是一个内存密集型应用程序。
  • 4 CPUs available to handle the throughput requirements of the agent. Decreasing the number of CPUs decreases the throughput linearly. Having additional CPUs does not provide significant gains.

The Snowflake Connector for MySQL requires exactly one instance of the agent application to be running at all times.

后续步骤

After completing these procedures, follow the steps in Prerequisites for Snowflake Connector for MySQL datasources.