Snowpark Library for Scala and Java release notes for 2024¶

New features¶

• Added support for reading structured types from Snowflake.

• Added the following new functions:

  • Variant.asJsonNode

  • Functions.round

  • Functions.hex

  • Functions.unhex

  • Functions.shiftleft

  • Functions.shiftright

  • Functions.reverse

  • Functions.isnull

  • Functions.unix_timestamp

  • Functions.locate

  • Functions.ntile

  • Functions.radn

  • Functions.randn

  • Functions.regexp_extract

  • Functions.signum

  • Functions.sign

  • Functions.substring_index

  • Functions.collect_list

  • Functions.log10

  • Functions.log1p

  • Functions.base64

  • Functions.unbase64

  • Functions.expr

  • Functions.array

  • Functions.date_format

  • Functions.last

  • Functions.desc

  • Functions.asc

  • Functions.size

Improvements¶

None.

Bug fixes¶

• Fixed incorrect time info in the Open Telemetry span

• Fix duplicated Open Telemetry span in the count action

New features¶

None.

Improvements¶

None.

Bug fixes¶

• Fixed Jackson Scala module compatibility issue.

New features¶

None.

Improvements¶

None.

Bug fixes¶

• When the session parameter ERROR_ON_NONDETERMINISTIC_UPDATE is set to true, calls to session.table(...).update(...) no longer report errors.

New features¶

• Emit span in Java/Scala stored procedure. Support functions:

  • All action functions

  • Register UDF/UDTF/SProc

• Enable retrieving cloud provider tokens in the SnowflakeSecrets class.

• New functions:

  • Session.updateQueryTag

  • functions.countDistinct

  • functions.max(String)

  • functions.min(String)

  • functions.mean(String)

Improvements¶

• App name in the session query tag is JSON format now.

• Upgraded SLF4J to 2.0.4

• Update documentation for SnowflakeFile

Bug fixes¶

• Variant object can’t handle null value

• DataFrame alias doesn’t work in the JOIN condition

New features¶

None.

Improvements¶

None.

Bug fixes¶

Fixed “Dataframe alias doesn’t work in the JOIN condition”.

New features¶

• Support the Geometry data type.

• New function: sum(String).

• Support setting an app name when creating a new session.

Improvements¶

Added code examples for the split function in the API document.

Bug fixes¶

None.

New features¶

• Support Java 17 stored procedure

  • When registering a stored procedure, Snowpark automatically sets runtime_version to 17 if the client is running with JVM 17.

Improvements¶

None.

Bug fixes¶

None.

New features¶

• Support Java 17.

  • Compatible with JVM 17.

  • When registering a UDF or UDTF, Snowpark automatically sets the runtime_version to 17 if the client is running with JVM 17.

• Support Dataframe alias.

  • You can use the DataFrame.alias function to assign DataFrames an alias for future reference.

    For example, you could use code such as the following:

    val df1 = df.alias("A")
    df1.join(df2).select(col("A.col"))
    

    Copy

    This is equivalent to df1.join(df2).select(df1("col")).

• Support for the explode function.

• You can invoke table functions in the DataFrame.select method.

• You can use table functions to read function arguments through the TableFunction.apply method.

• New session constructor Session.getOrCreate.

Improvements¶

• Upgraded JDBC to version 3.14.4.

• New wrapper for is_null function.

• Upgrade Scala to version 2.12.18.

Bug fixes¶

• Updated wrong license information.