description:

Some data type similarity between Snowflake and Snowpark

Snowpark Migration Accelerator: Spark SQL Data Types

Conversion Table

Spark SQLSnowflakeNotes
BIGINTBIGINT
BOOLEANBOOLEAN
BYTEBYTEINT
CHARCHAR
DATEDATE
DECIMALDECIMAL
DOUBLEDOUBLE
FLOATFLOAT
INTEGERINTEGER
LONGINTCheck out note
SHORTINTCheck out note
STRINGSTRING
TIMESTAMPTIMESTAMP_TZ
TIMESTAMPNTZTIMESTAMP_NTZ
VARCHARVARCHAR

Notes

Note

For more information, refer to the Spark SQL data types (https://spark.apache.org/docs/latest/sql-ref-datatypes.html#data-types) documentation.

Integer types

When converting integer data types from the source system, both LONG and SHORT are mapped to Snowflake’s INTEGER data type, as INTEGER can accommodate the full range of values for both data types.

  • SparkSQL LONG: Range from -32,768 to 32,767
  • SparkSQL SHORT: Range from -9,223,372,036,854,775,808 to 9,223,372,036,854,775,807
  • Snowflake INTEGER: Range from -9.9999999999999999999999999999999999999 x 10^38 to +9.9999999999999999999999999999999999999 x 10^38