Skip to content

Commit edac9be

Browse files
sfc-gh-anavalosSnowflake Authors
andauthored
Project import generated by Copybara. (#187)
GitOrigin-RevId: 3aef7cf11983ce38fddb89af5123813e7ccb011f Co-authored-by: Snowflake Authors <[email protected]>
1 parent b86c656 commit edac9be

File tree

79 files changed

+3116
-1451
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

79 files changed

+3116
-1451
lines changed

.bazelrc

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -51,7 +51,8 @@ run:all --config=_all
5151
# Environment variables for Hugging Face
5252
build --action_env=HF_HUB_ETAG_TIMEOUT=86400
5353
build --action_env=HF_HUB_DOWNLOAD_TIMEOUT=86400
54-
build --action_env=HF_ENDPOINT=https://artifactory.ci1.us-west-2.aws-dev.app.snowflake.com/artifactory/api/huggingfaceml/huggingface-remote
54+
build --action_env=HF_ENDPOINT=https://huggingface.co
55+
build --action_env=HF_TOKEN
5556

5657
# Below are auto-generated settings, do not modify them directly
5758

@@ -61,6 +62,12 @@ build:keras --config=_keras
6162
test:keras --config=_keras
6263
run:keras --config=_keras
6364

65+
build:_llm --platforms //bazel/platforms:llm_conda_env --host_platform //bazel/platforms:llm_conda_env --repo_env=BAZEL_CONDA_ENV_NAME=llm
66+
cquery:llm --config=_llm
67+
build:llm --config=_llm
68+
test:llm --config=_llm
69+
run:llm --config=_llm
70+
6471
build:_ml --platforms //bazel/platforms:ml_conda_env --host_platform //bazel/platforms:ml_conda_env --repo_env=BAZEL_CONDA_ENV_NAME=ml
6572
cquery:ml --config=_ml
6673
build:ml --config=_ml

CHANGELOG.md

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,21 @@
11
# Release History
22

3+
## 1.19.0
4+
5+
### Bug Fixes
6+
7+
* Experiment Tracking (PrPr): No longer throw an exception in `list_artifacts` when run does not have artifacts.
8+
* Registry: Fix `get_version_by_alias`: now requires an exact match of snowflake identifier.
9+
10+
### Behavior Changes
11+
12+
### New Features
13+
14+
* Online feature serving in Feature Store is in public preview.
15+
* Experiment Tracking (`snowflake.ml.experiment`) is in public preview.
16+
17+
### Deprecations
18+
319
## 1.18.0
420

521
### Bug Fixes

CONTRIBUTING.md

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -166,6 +166,25 @@ For example, to run all autogenerated tests locally:
166166
bazel test //... --test_tag_filters=autogen --config=core
167167
```
168168

169+
#### SPCS Model Serving
170+
171+
To run SPCS Model Serving integration tests locally, you can provide the Snowflake connection, CPU/GPU compute pools,
172+
and warehouse:
173+
174+
```sh
175+
bazel test //... \
176+
--test_env SNOWFLAKE_CONNECTION_NAME=<connection> \
177+
--test_env CPU_COMPUTE_POOL=<CPU_POOL> \
178+
--test_env GPU_COMPUTE_POOL=<GPU_POOL> \
179+
--test_env WAREHOUSE=<WAREHOUSE>
180+
```
181+
182+
To set up a Snowflake connection, you can either set the `private_key_path` in the configuration file (see Snowflake
183+
[documentation](https://docs.snowflake.com/en/user-guide/snowsql-start#using-key-pair-authentication-and-key-pair-rotation)
184+
for using key-pair authentication and key-pair rotation), or set a programmatic access token as the `password` in the
185+
configuration file (see Snowflake [documentation](https://docs.snowflake.com/en/user-guide/programmatic-access-tokens)
186+
for using programmatic access tokens for authentication).
187+
169188
### Coverage
170189

171190
A `lcov` coverage report can be generated by running

bazel/environments/conda-env-all.yml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -56,7 +56,7 @@ dependencies:
5656
- sentence-transformers==2.7.0
5757
- sentencepiece==0.1.99
5858
- shap==0.46.0
59-
- snowflake-connector-python==3.17.0
59+
- snowflake-connector-python==3.17.3
6060
- snowflake-snowpark-python==1.28.0
6161
- snowflake.core==1.0.5
6262
- sphinx==5.0.2
@@ -79,6 +79,6 @@ dependencies:
7979
- pip
8080
- pip:
8181
- --extra-index-url https://pypi.org/simple
82-
- accelerate==0.22.0
83-
- tf-keras==2.17.0
8482
- types-cachetools==4.2.2
83+
- accelerate==0.26.0
84+
- tf-keras==2.17.0

bazel/environments/conda-env-core.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -47,7 +47,7 @@ dependencies:
4747
- scikit-learn==1.5.1
4848
- scipy==1.11.3
4949
- shap==0.46.0
50-
- snowflake-connector-python==3.17.0
50+
- snowflake-connector-python==3.17.3
5151
- snowflake-snowpark-python==1.28.0
5252
- snowflake.core==1.0.5
5353
- sphinx==5.0.2

bazel/environments/conda-env-keras.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -49,7 +49,7 @@ dependencies:
4949
- scikit-learn==1.5.1
5050
- scipy==1.11.3
5151
- shap==0.46.0
52-
- snowflake-connector-python==3.17.0
52+
- snowflake-connector-python==3.17.3
5353
- snowflake-snowpark-python==1.28.0
5454
- snowflake.core==1.0.5
5555
- sphinx==5.0.2
Lines changed: 76 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,76 @@
1+
---
2+
# DO NOT EDIT!
3+
# Generate by running 'bazel run --config=pre_build //bazel/requirements:sync_requirements'
4+
5+
channels:
6+
- https://repo.anaconda.com/pkgs/snowflake
7+
- nodefaults
8+
dependencies:
9+
- absl-py==1.4.0
10+
- aiohttp==3.9.5
11+
- anyio==4.2.0
12+
- boto3==1.34.69
13+
- cachetools==5.3.3
14+
- cloudpickle==2.2.1
15+
- coverage==7.6.1
16+
- cryptography==41.0.3
17+
- flask-cors==3.0.10
18+
- flask==2.2.2
19+
- fsspec==2024.6.1
20+
- httpx==0.28.1
21+
- importlib_resources==6.1.1
22+
- inflection==0.5.1
23+
- joblib==1.4.2
24+
- jsonschema==4.23.0
25+
- mlflow==2.16.2
26+
- moto==5.0.5
27+
- mypy==1.10.0
28+
- networkx==3.1
29+
- numpy==1.26.4
30+
- packaging==24.1
31+
- pandas==2.1.4
32+
- platformdirs==4.3.7
33+
- protobuf==4.25.3
34+
- psutil==5.9.0
35+
- pyarrow==16.1.0
36+
- pydantic==2.8.2
37+
- pyjwt==2.8.0
38+
- pytest-timeout==2.2.0
39+
- pytest-xdist==3.5.0
40+
- pytest==7.4.0
41+
- python-build==0.10.0
42+
- pytimeparse==1.1.8
43+
- pytorch==2.5.1
44+
- pyyaml==6.0.1
45+
- requests==2.31.0
46+
- retrying==1.3.3
47+
- ruamel.yaml==0.17.21
48+
- s3fs==2024.6.1
49+
- scikit-learn==1.5.1
50+
- scipy==1.11.3
51+
- sentence-transformers==2.7.0
52+
- sentencepiece==0.1.99
53+
- shap==0.46.0
54+
- snowflake-connector-python==3.17.3
55+
- snowflake-snowpark-python==1.28.0
56+
- snowflake.core==1.0.5
57+
- sphinx==5.0.2
58+
- sqlparse==0.4.4
59+
- starlette==0.27.0
60+
- toml==0.10.2
61+
- torchdata==0.6.1
62+
- tqdm==4.67.1
63+
- types-PyYAML==6.0.12.12
64+
- types-protobuf==4.23.0.1
65+
- types-requests==2.30.0.0
66+
- types-toml==0.10.8.6
67+
- typing-extensions==4.11.0
68+
- werkzeug==2.3.8
69+
- xgboost==2.1.4
70+
- pip
71+
- pip:
72+
- --extra-index-url https://pypi.org/simple
73+
- types-cachetools==4.2.2
74+
- tokenizers==0.21.0
75+
- transformers==4.51.0
76+
- accelerate==0.26.0

bazel/environments/conda-env-ml.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -52,7 +52,7 @@ dependencies:
5252
- scikit-learn==1.5.1
5353
- scipy==1.11.3
5454
- shap==0.46.0
55-
- snowflake-connector-python==3.17.0
55+
- snowflake-connector-python==3.17.3
5656
- snowflake-snowpark-python==1.28.0
5757
- snowflake.core==1.0.5
5858
- sphinx==5.0.2

bazel/environments/conda-env-torch.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -51,7 +51,7 @@ dependencies:
5151
- sentence-transformers==2.7.0
5252
- sentencepiece==0.1.99
5353
- shap==0.46.0
54-
- snowflake-connector-python==3.17.0
54+
- snowflake-connector-python==3.17.3
5555
- snowflake-snowpark-python==1.28.0
5656
- snowflake.core==1.0.5
5757
- sphinx==5.0.2
@@ -73,4 +73,4 @@ dependencies:
7373
- pip:
7474
- --extra-index-url https://pypi.org/simple
7575
- types-cachetools==4.2.2
76-
- accelerate==0.22.0
76+
- accelerate==0.26.0
Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
---
2+
# DO NOT EDIT!
3+
# Generate by running 'bazel run --config=pre_build //bazel/requirements:sync_requirements'
4+
5+
channels:
6+
- https://repo.anaconda.com/pkgs/snowflake
7+
- nodefaults
8+
dependencies:
9+
- mlflow>=2.16.0, <3
10+
- pytorch>=2.0.1,<3
11+
- sentence-transformers>=2.7.0,<4
12+
- sentencepiece>=0.1.95,<0.2.0
13+
- torchdata>=0.4,<1

0 commit comments

Comments
 (0)