Snowpark Connect for Spark reference

This section provides reference documentation for Snowpark Connect for Spark, covering configuration, API compatibility, and client library details.

  • Parameters lists Spark and custom configuration properties that control session behavior, file I/O, and UDF execution.
  • DataFrame support details which Spark DataFrame API methods are supported, partially supported, or unsupported.
  • Dataset support covers the typed Dataset API for Java and Scala applications.
  • Snowpark Connect (Python) documents the Python snowpark-connect package.
  • Java/Scala client documents the com.snowflake:snowpark-connect-java-client library.
  • Snowpark Submit covers the CLI flags, configuration options, and output formats.