2025 年 Snowflake Connector for Kafka 版本说明¶

新功能¶

• The connector now automatically handles client redirect during failover, thus eliminating the need to manually restart the connector after a primary deployment change.

• Added automatic failover support for Snowpipe Streaming.

• Added granular logging for schema evolution to improve troubleshooting.

• Upgraded Snowflake Ingest SDK to version 4.4.0.

行为变更¶

• Changed default value of enable.streaming.channel.offset.migration property to false. This property was used only when the Snowflake Streaming channel was first used after migrating from Kafka Connector version 2.1.0 or 2.1.1: it enabled migration of offsets from channels created by those versions (which included the connector name in the channel name: [connectorName]_[topic]_[partition]) to the channel name format used by all other versions ([topic]_[partition]).

新功能¶

• Added snowflake.streaming.channel.name.include.connector.name property. When set to true, this includes the connector name in Snowpipe Streaming channel names ([connectorName]_[topic]_[partition]). Setting this property to true requires enable.streaming.channel.offset.migration to be set to false. This allows users of Kafka Connector versions 2.1.0 and 2.1.1 to upgrade without data loss.

  警告

  Users upgrading from versions other than 2.1.0 and 2.1.1 who set snowflake.streaming.channel.name.include.connector.name to true will experience data duplication; there is no offset migration logic for other versions.

• Upgraded Snowflake Ingest SDK to version 4.3.2.

错误修复¶

Not applicable.

新功能¶

• Upgraded Snowflake JDBC driver to version 3.26.1.

错误修复¶

• OAuth URLs now support dots and hyphens.

行为变更¶

不适用

新功能¶

• The Snowflake Connector for Kafka now supports long type with timestamp logical type in Apache Iceberg™ tables.

  For a complete list of support types see Apache Iceberg™ 表的数据类型.

错误修复¶

Not applicable.

行为变更¶

不适用

新功能¶

• Uses Confluent version 7.9.2 packages.

错误修复¶

不适用

行为变更¶

不适用

新功能¶

• Uses JDBC version 3.24.2.

错误修复¶

不适用

行为变更¶

不适用

新功能¶

• Removed support for double buffered version for SNOWPIPE_STREAMING ingestion type.

  Setting snowflake.streaming.enable.single.buffer has no effect.

错误修复¶

• The connector no longer drops table rows with missing offsets.

• During schema evolution, on schema change, certain single records are no longer dropped.

行为变更¶

• Snowpipe Streaming with double buffer is now deprecated. Only single buffer will be supported in future releases.

新功能和改进¶

• Updated connector to use Kafka version 3.9.0.

• Updated connector to use slf4j-api version 2.0.17.

• Supports JDBC version 3.23.2.

错误修复¶

• snowflake-jdbc no longer throws NullPointerException in certain situations.

行为变更¶

不适用

新功能¶

• Supports using -Infinity values in a floating-point number.

• Updated connector to use Confluent version 7.9.0 packages.

• Supports JDBC version 3.21.1.

错误修复¶

Not applicable.

行为变更¶

• max_client_lag in Snowpipe Streaming default value changed from 120s to 30s.

新功能¶

不适用

错误修复¶

Not applicable.

行为变更¶

不适用

新功能¶

• The Snowflake Connector for Kafka now supports external OAuth authentication.

• The Snowflake Connector for Kafka now uses Confluent version 7.8.0.

错误修复¶

• 在架构演化过程中偏移量不连续时，连接器不再引发 IndexOutOfBoundException。

• 对于 Snowpipe 引入方法，当 snowflake.topic2table.map 参数配置为将多个主题映射到单个表时，连接器会向暂存区文件前缀添加主题的 salt hashCode，以避免文件冲突，并从所有指定主题加载数据。