NotificationsYou must be signed in to change notification settings
Fork352
Star6.6k

Commit76ed537

authored

llama 3.1 support (#1586)

1 parent2c2ff02 commit76ed537Copy full SHA for 76ed537

File tree

11 files changed

+83

-93

lines changed

.github/workflows
- ubuntu-packages-and-docker-image.yml
pgml-cms/docs/open-source/pgml/developers
- contributing.md
- installation.md
- quick-start-with-docker.md
- self-hosting
  - pooler.md
pgml-extension
- Cargo.lock
- Cargo.toml
- examples
  - transformers.sql
- requirements.linux.txt
- requirements.txt
- sql
  - pgml--2.9.2--2.9.3.sql

11 files changed

+83

-93

lines changed

`‎.github/workflows/ubuntu-packages-and-docker-image.yml‎`

Lines changed: 1 addition & 1 deletion

Original file line number	Diff line number	Diff line change
`@@ -4,7 +4,7 @@ on:`
`4`	`4`	`workflow_dispatch:`
`5`	`5`	`inputs:`
`6`	`6`	`packageVersion:`
`7`		`-default:"2.9.2"`
	`7`	`+default:"2.9.3"`
`8`	`8`	`jobs:`
`9`	`9`	`#`
`10`	`10`	`# PostgresML extension.`

`‎pgml-cms/docs/open-source/pgml/developers/contributing.md‎`

Lines changed: 1 addition & 1 deletion

Original file line number	Diff line number	Diff line change
`@@ -127,7 +127,7 @@ SELECT pgml.version();`
`127`	`127`	`postgres=# select pgml.version();`
`128`	`128`	`version`
`129`	`129`	`-------------------`
`130`		`- 2.9.2`
	`130`	`+ 2.9.3`
`131`	`131`	`(1 row)`
`132`	`132`	```
`133`	`133`	`{% endtab %}`

`‎pgml-cms/docs/open-source/pgml/developers/installation.md‎`

Lines changed: 1 addition & 1 deletion

Original file line number	Diff line number	Diff line change
`@@ -132,7 +132,7 @@ CREATE EXTENSION`
`132`	`132`	`pgml_test=# SELECT pgml.version();`
`133`	`133`	`version`
`134`	`134`	`---------`
`135`		`- 2.9.2`
	`135`	`+ 2.9.3`
`136`	`136`	`(1 row)`
`137`	`137`	```
`138`	`138`

`‎pgml-cms/docs/open-source/pgml/developers/quick-start-with-docker.md‎`

Lines changed: 3 additions & 3 deletions

Original file line number	Diff line number	Diff line change
`@@ -18,7 +18,7 @@ docker run \`
`18`	`18`	`-v postgresml_data:/var/lib/postgresql \`
`19`	`19`	`-p 5433:5432 \`
`20`	`20`	`-p 8000:8000 \`
`21`		`- ghcr.io/postgresml/postgresml:2.9.2 \`
	`21`	`+ ghcr.io/postgresml/postgresml:2.9.3 \`
`22`	`22`	`sudo -u postgresml psql -d postgresml`
`23`	`23`	```
`24`	`24`	`{% endtab %}`
`@@ -43,7 +43,7 @@ docker run \`
`43`	`43`	`--gpus all \`
`44`	`44`	`-p 5433:5432 \`
`45`	`45`	`-p 8000:8000 \`
`46`		`- ghcr.io/postgresml/postgresml:2.9.2 \`
	`46`	`+ ghcr.io/postgresml/postgresml:2.9.3 \`
`47`	`47`	`sudo -u postgresml psql -d postgresml`
`48`	`48`	```
`49`	`49`
`@@ -80,7 +80,7 @@ Time: 41.520 ms`
`80`	`80`	`postgresml=# SELECT pgml.version();`
`81`	`81`	`version`
`82`	`82`	`---------`
`83`		`- 2.9.2`
	`83`	`+ 2.9.3`
`84`	`84`	`(1 row)`
`85`	`85`	```
`86`	`86`

`‎pgml-cms/docs/open-source/pgml/developers/self-hosting/pooler.md‎`

Lines changed: 1 addition & 1 deletion

Original file line number	Diff line number	Diff line change
`@@ -115,6 +115,6 @@ Type "help" for help.`
`115`	`115`	`postgresml=> SELECT pgml.version();`
`116`	`116`	`version`
`117`	`117`	`---------`
`118`		`- 2.9.2`
	`118`	`+ 2.9.3`
`119`	`119`	`(1 row)`
`120`	`120`	```

`‎pgml-extension/Cargo.lock‎`

Lines changed: 1 addition & 1 deletion

Some generated files are not rendered by default. Learn more aboutcustomizing how changed files appear on GitHub.

`‎pgml-extension/Cargo.toml‎`

Lines changed: 1 addition & 1 deletion

Original file line number	Diff line number	Diff line change
`@@ -1,6 +1,6 @@`
`1`	`1`	`[package]`
`2`	`2`	`name ="pgml"`
`3`		`-version ="2.9.2"`
	`3`	`+version ="2.9.3"`
`4`	`4`	`edition ="2021"`
`5`	`5`
`6`	`6`	`[lib]`

`‎pgml-extension/examples/transformers.sql‎`

Lines changed: 4 additions & 6 deletions

Original file line number	Diff line number	Diff line change
`@@ -8,16 +8,14 @@ SELECT pgml.embed('Alibaba-NLP/gte-base-en-v1.5', 'hi mom', '{"device": "cpu"}')`
`8`	`8`	`SELECTpgml.embed('hkunlp/instructor-xl','hi mom','{"instruction": "Encode it with love"}');`
`9`	`9`	`SELECTpgml.embed('mixedbread-ai/mxbai-embed-large-v1','test','{"prompt": "test prompt: "}');`
`10`	`10`
`11`		`-SELECTpgml.transform_stream(`
	`11`	`+SELECTpgml.transform(`
`12`	`12`	`task=>'{`
`13`	`13`	`"task": "text-generation",`
`14`	`14`	`"model": "meta-llama/Meta-Llama-3.1-8B-Instruct",`
`15`		`- "model_type": "mistral",`
`16`		`- "revision": "main",`
`17`		`- "device_map": "auto",`
`18`		`- "token": "hf_123"`
	`15`	`+ "token": "hf_123",`
	`16`	`+ "trust_remote_code": true`
`19`	`17`	`}'::JSONB,`
`20`		`-input=>'AI is going to',`
	`18`	`+inputs=>ARRAY['AI is going to'],`
`21`	`19`	`args=>'{`
`22`	`20`	`"max_new_tokens": 100`
`23`	`21`	`}'::JSONB`

`‎pgml-extension/requirements.linux.txt‎`

Lines changed: 70 additions & 77 deletions

Original file line number	Diff line number	Diff line change
`@@ -1,84 +1,78 @@`
`1`		`-accelerate==0.30.1`
	`1`	`+accelerate==0.33.0`
`2`	`2`	`aiohttp==3.9.5`
`3`	`3`	`aiosignal==1.3.1`
`4`		`-annotated-types==0.6.0`
`5`		`-anyio==4.3.0`
	`4`	`+annotated-types==0.7.0`
	`5`	`+anyio==4.4.0`
`6`	`6`	`async-timeout==4.0.3`
`7`	`7`	`attrs==23.2.0`
`8`	`8`	`auto_gptq==0.7.1`
`9`		`-bitsandbytes==0.43.1`
	`9`	`+bitsandbytes==0.43.2`
`10`	`10`	`catboost==1.2.5`
`11`		`-certifi==2024.2.2`
	`11`	`+certifi==2024.7.4`
`12`	`12`	`charset-normalizer==3.3.2`
`13`	`13`	`click==8.1.7`
`14`	`14`	`cloudpickle==3.0.0`
`15`		`-cmake==3.29.2`
	`15`	`+cmake==3.30.1`
`16`	`16`	`colorama==0.4.6`
`17`		`-coloredlogs==15.0.1`
`18`	`17`	`contourpy==1.2.1`
`19`	`18`	`ctransformers==0.2.27`
`20`	`19`	`cycler==0.12.1`
`21`		`-dataclasses-json==0.6.6`
`22`	`20`	`datasets==2.16.1`
`23`		`-deepspeed==0.14.2`
	`21`	`+deepspeed==0.14.4`
`24`	`22`	`dill==0.3.7`
`25`	`23`	`diskcache==5.6.3`
`26`	`24`	`distro==1.9.0`
`27`	`25`	`dnspython==2.6.1`
`28`	`26`	`docstring_parser==0.16`
`29`	`27`	`einops==0.8.0`
`30`		`-email_validator==2.1.1`
	`28`	`+email_validator==2.2.0`
`31`	`29`	`evaluate==0.4.2`
`32`		`-exceptiongroup==1.2.1`
`33`		`-fastapi==0.111.0`
`34`		`-fastapi-cli==0.0.3`
`35`		`-filelock==3.14.0`
`36`		`-fonttools==4.51.0`
	`30`	`+exceptiongroup==1.2.2`
	`31`	`+fastapi==0.111.1`
	`32`	`+fastapi-cli==0.0.4`
	`33`	`+filelock==3.15.4`
	`34`	`+fonttools==4.53.1`
`37`	`35`	`frozenlist==1.4.1`
`38`	`36`	`fsspec==2023.10.0`
`39`		`-gekko==1.1.1`
	`37`	`+gekko==1.2.1`
`40`	`38`	`graphviz==0.20.3`
`41`	`39`	`greenlet==3.0.3`
`42`	`40`	`h11==0.14.0`
`43`	`41`	`hjson==3.1.0`
`44`	`42`	`httpcore==1.0.5`
`45`	`43`	`httptools==0.6.1`
`46`	`44`	`httpx==0.27.0`
`47`		`-huggingface-hub==0.23.0`
`48`		`-humanfriendly==10.0`
	`45`	`+huggingface-hub==0.24.1`
`49`	`46`	`idna==3.7`
`50`	`47`	`interegular==0.3.3`
`51`	`48`	`Jinja2==3.1.4`
`52`	`49`	`joblib==1.4.2`
`53`	`50`	`jsonpatch==1.33`
`54`		`-jsonpointer==2.4`
`55`		`-jsonschema==4.22.0`
	`51`	`+jsonpointer==3.0.0`
	`52`	`+jsonschema==4.23.0`
`56`	`53`	`jsonschema-specifications==2023.12.1`
`57`	`54`	`kiwisolver==1.4.5`
`58`		`-langchain==0.1.19`
`59`		`-langchain-community==0.0.38`
`60`		`-langchain-core==0.1.52`
`61`		`-langchain-text-splitters==0.0.1`
`62`		`-langsmith==0.1.56`
	`55`	`+langchain==0.2.11`
	`56`	`+langchain-core==0.2.23`
	`57`	`+langchain-text-splitters==0.2.2`
	`58`	`+langsmith==0.1.93`
`63`	`59`	`lark==1.1.9`
`64`		`-lightgbm==4.3.0`
`65`		`-llvmlite==0.42.0`
`66`		`-lm-format-enforcer==0.9.8`
`67`		`-lxml==5.2.1`
	`60`	`+lightgbm==4.4.0`
	`61`	`+llvmlite==0.43.0`
	`62`	`+lm-format-enforcer==0.10.3`
	`63`	`+lxml==5.2.2`
`68`	`64`	`markdown-it-py==3.0.0`
`69`	`65`	`MarkupSafe==2.1.5`
`70`		`-marshmallow==3.21.2`
`71`		`-matplotlib==3.8.4`
	`66`	`+matplotlib==3.9.1`
`72`	`67`	`mdurl==0.1.2`
`73`	`68`	`mpmath==1.3.0`
`74`	`69`	`msgpack==1.0.8`
`75`	`70`	`multidict==6.0.5`
`76`	`71`	`multiprocess==0.70.15`
`77`		`-mypy-extensions==1.0.0`
`78`	`72`	`nest-asyncio==1.6.0`
`79`	`73`	`networkx==3.3`
`80`	`74`	`ninja==1.11.1.1`
`81`		`-numba==0.59.1`
	`75`	`+numba==0.60.0`
`82`	`76`	`numpy==1.26.4`
`83`	`77`	`nvidia-cublas-cu12==12.1.3.1`
`84`	`78`	`nvidia-cuda-cupti-cu12==12.1.105`
`@@ -89,85 +83,84 @@ nvidia-cufft-cu12==11.0.2.54`
`89`	`83`	`nvidia-curand-cu12==10.3.2.106`
`90`	`84`	`nvidia-cusolver-cu12==11.4.5.107`
`91`	`85`	`nvidia-cusparse-cu12==12.1.0.106`
`92`		`-nvidia-ml-py==12.550.52`
	`86`	`+nvidia-ml-py==12.555.43`
`93`	`87`	`nvidia-nccl-cu12==2.20.5`
`94`		`-nvidia-nvjitlink-cu12==12.4.127`
	`88`	`+nvidia-nvjitlink-cu12==12.5.82`
`95`	`89`	`nvidia-nvtx-cu12==12.1.105`
`96`		`-openai==1.28.0`
`97`		`-optimum==1.19.2`
`98`		`-orjson==3.10.3`
`99`		`-outlines==0.0.34`
`100`		`-packaging==23.2`
	`90`	`+openai==1.37.0`
	`91`	`+orjson==3.10.6`
	`92`	`+outlines==0.0.46`
	`93`	`+packaging==24.1`
`101`	`94`	`pandas==2.2.2`
`102`		`-peft==0.10.0`
`103`		`-pillow==10.3.0`
`104`		`-plotly==5.22.0`
`105`		`-portalocker==2.8.2`
	`95`	`+peft==0.11.1`
	`96`	`+pillow==10.4.0`
	`97`	`+plotly==5.23.0`
	`98`	`+portalocker==2.10.1`
`106`	`99`	`prometheus-fastapi-instrumentator==7.0.0`
`107`	`100`	`prometheus_client==0.20.0`
`108`		`-protobuf==5.26.1`
`109`		`-psutil==5.9.8`
	`101`	`+protobuf==5.27.2`
	`102`	`+psutil==6.0.0`
`110`	`103`	`py-cpuinfo==9.0.0`
	`104`	`+pyairports==2.1.1`
`111`	`105`	`pyarrow==11.0.0`
`112`	`106`	`pyarrow-hotfix==0.6`
`113`		`-pydantic==2.7.1`
`114`		`-pydantic_core==2.18.2`
	`107`	`+pycountry==24.6.1`
	`108`	`+pydantic==2.8.2`
	`109`	`+pydantic_core==2.20.1`
`115`	`110`	`Pygments==2.18.0`
`116`		`-pynvml==11.5.0`
`117`	`111`	`pyparsing==3.1.2`
`118`	`112`	`python-dateutil==2.9.0.post0`
`119`	`113`	`python-dotenv==1.0.1`
`120`	`114`	`python-multipart==0.0.9`
`121`	`115`	`pytz==2024.1`
`122`	`116`	`PyYAML==6.0.1`
`123`		`-ray==2.21.0`
	`117`	`+pyzmq==26.0.3`
	`118`	`+ray==2.32.0`
`124`	`119`	`referencing==0.35.1`
`125`		`-regex==2024.5.10`
`126`		`-requests==2.31.0`
	`120`	`+regex==2024.5.15`
	`121`	`+requests==2.32.3`
`127`	`122`	`rich==13.7.1`
`128`	`123`	`rouge==1.0.1`
`129`		`-rpds-py==0.18.1`
	`124`	`+rpds-py==0.19.0`
`130`	`125`	`sacrebleu==2.4.2`
`131`	`126`	`sacremoses==0.1.1`
`132`	`127`	`safetensors==0.4.3`
`133`		`-scikit-learn==1.4.2`
`134`		`-scipy==1.13.0`
`135`		`-sentence-transformers==2.7.0`
	`128`	`+scikit-learn==1.5.1`
	`129`	`+scipy==1.14.0`
	`130`	`+sentence-transformers==3.0.1`
`136`	`131`	`sentencepiece==0.2.0`
`137`	`132`	`shellingham==1.5.4`
`138`	`133`	`shtab==1.7.1`
`139`	`134`	`six==1.16.0`
`140`	`135`	`sniffio==1.3.1`
`141`		`-SQLAlchemy==2.0.30`
	`136`	`+SQLAlchemy==2.0.31`
`142`	`137`	`starlette==0.37.2`
`143`		`-sympy==1.12`
	`138`	`+sympy==1.13.1`
`144`	`139`	`tabulate==0.9.0`
`145`		`-tenacity==8.3.0`
	`140`	`+tenacity==8.5.0`
`146`	`141`	`threadpoolctl==3.5.0`
`147`		`-tiktoken==0.6.0`
	`142`	`+tiktoken==0.7.0`
`148`	`143`	`tokenizers==0.19.1`
`149`		`-torch==2.3.0`
`150`		`-torchaudio==2.3.0`
`151`		`-torchvision==0.18.0`
	`144`	`+torch==2.3.1`
	`145`	`+torchaudio==2.3.1`
	`146`	`+torchvision==0.18.1`
`152`	`147`	`tqdm==4.66.4`
`153`		`-transformers==4.40.2`
	`148`	`+transformers==4.43.1`
`154`	`149`	`transformers-stream-generator==0.0.5`
`155`		`-triton==2.3.0`
`156`		`-trl==0.8.6`
	`150`	`+triton==2.3.1`
	`151`	`+trl==0.9.6`
`157`	`152`	`typer==0.12.3`
`158`		`-typing-inspect==0.9.0`
`159`		`-typing_extensions==4.11.0`
`160`		`-tyro==0.8.4`
	`153`	`+typing_extensions==4.12.2`
	`154`	`+tyro==0.8.5`
`161`	`155`	`tzdata==2024.1`
`162`		`-ujson==5.9.0`
`163`		`-urllib3==2.2.1`
`164`		`-uvicorn==0.29.0`
	`156`	`+urllib3==2.2.2`
	`157`	`+uvicorn==0.30.3`
`165`	`158`	`uvloop==0.19.0`
`166`		`-vllm==0.4.2`
`167`		`-vllm-nccl-cu12==2.18.1.0.4.0`
`168`		`-watchfiles==0.21.0`
	`159`	`+vllm==0.5.3.post1`
	`160`	`+vllm-flash-attn==2.5.9.post1`
	`161`	`+watchfiles==0.22.0`
`169`	`162`	`websockets==12.0`
`170`		`-xformers==0.0.26.post1`
`171`		`-xgboost==2.0.3`
	`163`	`+xformers==0.0.27`
	`164`	`+xgboost==2.1.0`
`172`	`165`	`xxhash==3.4.1`
`173`	`166`	`yarl==1.9.4`

`‎pgml-extension/requirements.txt‎`

Lines changed: 0 additions & 1 deletion

Original file line number	Diff line number	Diff line change
`@@ -30,7 +30,6 @@ ctransformers`
`30`	`30`	`huggingface-hub`
`31`	`31`	`deepspeed`
`32`	`32`	`einops`
`33`		`-optimum`
`34`	`33`	`peft`
`35`	`34`	`tokenizers`
`36`	`35`	`transformers`

0 commit comments

Comments

(0)

Movatterモバイル変換

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Commit76ed537

File tree

11 files changed

11 files changed

`‎.github/workflows/ubuntu-packages-and-docker-image.yml‎`

`‎pgml-cms/docs/open-source/pgml/developers/contributing.md‎`

`‎pgml-cms/docs/open-source/pgml/developers/installation.md‎`

`‎pgml-cms/docs/open-source/pgml/developers/quick-start-with-docker.md‎`

`‎pgml-cms/docs/open-source/pgml/developers/self-hosting/pooler.md‎`

`‎pgml-extension/Cargo.lock‎`

`‎pgml-extension/Cargo.toml‎`

`‎pgml-extension/examples/transformers.sql‎`

`‎pgml-extension/requirements.linux.txt‎`

`‎pgml-extension/requirements.txt‎`

0 commit comments