ConsumeSnowflakeStream 2025.3.28.13-SNAPSHOT

BUNDLE

com.snowflake.openflow.runtime | runtime-snowflake-processors-nar

DESCRIPTION

Fetches data from a Snowflake stream and writes it to a FlowFile.The stream must be created in the database before using this processor.The processor will consume the stream and write the records to the FlowFile using the specified Record Writer.The processor will also add an attribute to the FlowFile with the name of the stream.The processor will not work if the stream is stale. Instead it will log an error message and stop processing.Stale stream has to be recreated in the database. After the stream is recreated in the database the processor will continueto read and process CDC records.For more information on Snowflake streams, see the <a href=”https://docs.snowflake.cn/en/user-guide/streams-intro”>snowflake documentation</a>.

TAGS

connection, database, jdbc, openflow, snowflake, stream, table, view

INPUT REQUIREMENT

FORBIDDEN

Supports Sensitive Dynamic Properties

false

PROPERTIES

Property

Description

Record Writer

The Record Writer to use for CDC record serialization

Snowflake Connection Service

Database Connection Service for accessing Snowflake

Stream Name

The name of the stream in the database

RELATIONSHIPS

NAME

DESCRIPTION

success

For FlowFiles with stream CDC records

WRITES ATTRIBUTES

NAME

DESCRIPTION

snowflake.stream.name

Name of the Snowflake Stream

Language: English