MergeSnowflakeJournalTable 2025.3.28.13-SNAPSHOT¶
BUNDLE¶
com.snowflake.openflow.runtime | runtime-database-cdc-processors-nar
DESCRIPTION¶
Triggers a merge operation on changes from journal table to a destination table in Snowflake. The merge operation is performed asynchronously and the processor polls the result of the operation. If the query is still in progress the flow file will be penalized.
INPUT REQUIREMENT¶
REQUIRED
Supports Sensitive Dynamic Properties¶
false
PROPERTIES¶
Property |
Description |
|---|---|
Destination Database Name |
The name of the Snowflake database where the data is being ingested to. |
Merge Query Retry Count |
Indicates how many times the merge query should be retried if it fails. |
Record Reader |
The Record Reader to use for reading the input |
Snowflake Connection Pool |
The Controller Service that is used to obtain a connection to the Snowflake database to perform merge operation. |
RELATIONSHIPS¶
NAME |
DESCRIPTION |
|---|---|
unknown file type |
Unknown file type. |
failure retry |
Retry failure query execution. |
failure |
Failure query execution. |
success |
Success query execution. |
poll query result |
Scheduled async query execution. |
ddl |
DDL to execute. |
deleted during compaction |
FlowFile deleted during compaction based on table name and generation. |
WRITES ATTRIBUTES¶
NAME |
DESCRIPTION |
|---|---|
merge.query.id |
The ID of the query that is used to merge the journal table into the target table. |