- Notifications
You must be signed in to change notification settings - Fork328
Setup - PostgresML#541
-
Setup - PostgresMLTrain and deploy models to make online predictions using only SQL, with an open source Postgres extension. |
BetaWas this translation helpful?Give feedback.
All reactions
Replies: 4 comments 4 replies
-
Two things. First, running the installation commands as shown with WARNING: Running pip as the'root' user can resultin broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv Is it necessary to use Second, and more important, after following the instructions to the letter, I get this error when trying to use transformers. psql (14.6 (Ubuntu14.6-0ubuntu0.22.04.1))Type"help" for help.postgres=# SELECT pgml.transform('translation_en_to_fr', inputs=> ARRAY['Welcome to the future!','Where have you been all this time?' ])AS french;ERROR: called`Result::unwrap()`on an`Err` value: PyErr { type:<class'ModuleNotFoundError'>, value: ModuleNotFoundError("No module named 'transformers'"), traceback: Some(<traceback object at 0x7fbaea7dc700>) }CONTEXT: src/bindings/transformers.rs:19:62 This is for postgresql-14 and pgml-14 on Ubuntu 22. |
BetaWas this translation helpful?Give feedback.
All reactions
-
There may be ways we could get around this by using individual package managers (e.g. apt on debian/ubuntu) to install Python dependencies system wide, but we'd need documentation for every distribution and OS. I think a better path forward would be to sandbox the Postgres plPython dependencies (or at least just our own) using a virtualenv forpy03.
|
BetaWas this translation helpful?Give feedback.
All reactions
-
Hello, would you please provide guidance on how to install postgresML extension on CentOS ? Many thanks ! |
BetaWas this translation helpful?Give feedback.
All reactions
-
Hi@ahmedrachid, we don't maintain a CentOS package, although you can convert the |
BetaWas this translation helpful?Give feedback.
All reactions
-
Oh i see.. I will give it a try then, many thanks for your answer. I'll be testing it in a distributed MPP PostgreSQL, do you think that model training can be distributed ? |
BetaWas this translation helpful?Give feedback.
All reactions
-
PostgresML training happens in a single connection process, so it will not work out of the box to distribute training throughout a Postgres-XL cluster. Parallelization happens within the training algorithm, although training can be offloaded to a replica. |
BetaWas this translation helpful?Give feedback.
All reactions
-
That's great to know, many thanks for your help :) |
BetaWas this translation helpful?Give feedback.
All reactions
-
Hello@montanalow , can you please share with me the "deb" package link ? I'm unable to find it and would like to use Alien to convert it to RPM. Many thanks |
BetaWas this translation helpful?Give feedback.