- Notifications
You must be signed in to change notification settings - Fork328
Mistral AI and GGUF and Qwen support#1125
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.
Already on GitHub?Sign in to your account
Uh oh!
There was an error while loading.Please reload this page.
Changes fromall commits
File filter
Filter by extension
Conversations
Uh oh!
There was an error while loading.Please reload this page.
Jump to
Uh oh!
There was an error while loading.Please reload this page.
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -4,7 +4,7 @@ on: | ||
workflow_dispatch: | ||
inputs: | ||
packageVersion: | ||
default: "2.7.13" | ||
jobs: | ||
# | ||
# PostgresML extension. | ||
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -4,7 +4,7 @@ on: | ||
workflow_dispatch: | ||
inputs: | ||
packageVersion: | ||
default: "2.7.13" | ||
jobs: | ||
postgresml-python: | ||
Some generated files are not rendered by default. Learn more abouthow customized files appear on GitHub.
Uh oh!
There was an error while loading.Please reload this page.
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,6 +1,6 @@ | ||
[package] | ||
name = "pgml" | ||
version = "2.7.13" | ||
edition = "2021" | ||
[lib] | ||
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -197,7 +197,7 @@ def create_pipeline(task): | ||
lower = model_name.lower() | ||
else: | ||
lower = None | ||
if lower and("-ggml" in lower or "-gguf" in lower): | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others.Learn more. @kczimm these run on the CPU, so could be useful for local dev on a M1. I'll try on my end just to be sure (on my desktop right now) There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others.Learn more. Worked on my M1 after uninstalling | ||
pipe = GGMLPipeline(model_name, **task) | ||
elif lower and "-gptq" in lower: | ||
pipe = GPTQPipeline(model_name, **task) | ||