- description:
This page outlines the step-by-step process for the validation procedure.
Snowpark Migration Accelerator: Validation¶
To proceed with the validation process, follow the steps outlined below:
-
Copy the
snowpark-checkpoints-outputfolder, generated during the collection process, into the validation workload..png)
-
Open the validation workload in VS Code to begin the validation process.
.png)
-
Generate checkpoints using the
checkpoints.jsonfile.
To generate checkpoints you can do one of the following actions:
- Generate them by accepting the suggesting message:
.png)
- Execution “Snowflake: Load All Checkpoints command”
.png)
Once all checkpoints are loaded, your files should appear as follows:
.png)
- Run the Python file to execute the checkpoints validation process.
When running a python file that contains validation checkpoints, the validation results are going to be shown in the copied “snowpark-checkpoints-output” folder as “checkpoints_validation_results.json”:
.png)
The “checkpoints_validation_results.json” contains the unified results of the collection process
The validation results, as seen above, will contain the comparison result between the PySpark and Snowpark DataFrames.