GenerateAnswersFromGroundTruth 2025.3.28.13-SNAPSHOT

BUNDLE

com.snowflake.openflow.runtime | runtime-rag-evaluation-processors-nar

DESCRIPTION

Generates synthetic answers for each question in the incoming records using an LLM. The synthetic answers are added to the specified RecordPath within each record. Additionally, the processor tracks the number of answers generated and updates the FlowFile attributes accordingly.

TAGS

ai, answers, generation, llm, nlp, openai, openflow, rag, synthetic

INPUT REQUIREMENT

REQUIRED

Supports Sensitive Dynamic Properties

false

PROPERTIES

Property

Description

Answer Record Path

The RecordPath to the synthetically generated answers.

Ground Truth Record Path

The RecordPath to the ground truth field in the record.

LLM Provider Service

The provider service for sending evaluation prompts to LLM

Question Record Path

The RecordPath to the question field in the record.

Record Reader

The Record Reader to use for reading the FlowFile.

Record Writer

The Record Writer to use for writing the results.

RELATIONSHIPS

NAME

DESCRIPTION

failure

FlowFiles that cannot be processed are routed to this relationship

success

FlowFiles that are successfully processed are routed to this relationship

WRITES ATTRIBUTES

NAME

DESCRIPTION

answers.successfully.generated

The total number of successfully synthetic answers generated for the FlowFile.

answers.failed.generated

The total number of failed answer generation for the FlowFile.

json.parse.failures

Number of JSON parse failures encountered.

Language: English