Snowflake Container Runtime GPU Version 2.9 (Latest)¶

Added¶

• Per-job tuning of the file-level disk cache via a file_cache_config dict, accepted alongside use_file_cache on every stage datasource, create_stage_filesystem, SFStageFileSystem and RayDataIngester — e.g. SFStageShardDataSource(..., use_file_cache=True, file_cache_config={"max_disk_pct": 70}). Knobs: max_disk_pct (cap the cache at that percent of disk, overriding MLRS_FILE_CACHE_MAX_DISK_PCT), evict_interval_sec (how often least-recently-used eviction may scan; default 30s), cache_dir (absolute path replacing $TMPDIR as the cache root, to put the cache on a different filesystem) and disk_subdir (the path within that root). Omitted knobs keep their current behaviour, and an unrecognised or malformed knob is rejected up front rather than silently ignored. Like use_file_cache, the settings reach every Ray worker, so they apply cluster-wide for the job; the cache location is fixed once the cache is in use, so set it before the first cached read.

The following lists the packages available for each Python version of GPU version 2.9.