- Notifications
You must be signed in to change notification settings - Fork328
add product to nav#1545
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.
Already on GitHub?Sign in to your account
Merged
Uh oh!
There was an error while loading.Please reload this page.
Merged
add product to nav#1545
Changes fromall commits
Commits
Show all changes
21 commits Select commitHold shift + click to select a range
1c71108 add product to nav
chillenberger41ceca2 add pgcat icon as font, update footer
chillenberger1b59410 Changed structure and cleaned up Korvus docs
SilasMarvin61264ef Korvus docs in a decent place
SilasMarvin29624bb Added pgml.transform_stream docs and cleaned up pgml docs a bit
SilasMarvin0977a52 Move PgCat under open source
SilasMarvina526c6f Fix spelling error
SilasMarvin5bf2e05 Update the docs landing page
SilasMarvin0cf476b Update product section of docs
SilasMarvinc2cce09 Add correct route for enterprise plan
SilasMarvin71a9655 Merge branch 'master' into dan-korvus-nav-update
chillenberger8bdd015 Clean up semantic search example app
SilasMarvina831255 add korvus icon, widen nav dropdown bridge, align product dropdown text
chillenberger2f995d6 update korvus icon font
chillenbergerc0a4c8c Korvus blog post
SilasMarvinf26ad3e Updated date for korvus launch blog post
SilasMarvin89608ce Cloud docs outline (#1553)
montanalow89925e1 Merge remote-tracking branch 'origin/silas-docs-overhaul' into dan-ko…
chillenberger2464fb6 Merge remote-tracking branch 'origin/silas-docs-overhaul' into dan-ko…
chillenbergera9847b6 update links to korvus nav
chillenbergerc32fdcb update solutions links and footer
chillenbergerFile filter
Filter by extension
Conversations
Failed to load comments.
Loading
Uh oh!
There was an error while loading.Please reload this page.
Jump to
Jump to file
Failed to load files.
Loading
Uh oh!
There was an error while loading.Please reload this page.
Diff view
Diff view
There are no files selected for viewing
Binary file addedpgml-cms/blog/.gitbook/assets/Blog-Image_Korvus-Release.jpg
Loading
Sorry, something went wrong.Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
1 change: 1 addition & 0 deletionspgml-cms/blog/SUMMARY.md
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
156 changes: 156 additions & 0 deletionspgml-cms/blog/introducing-korvus-the-all-in-one-rag-pipeline-for-postgresml.md
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,156 @@ | ||
| --- | ||
| description:Meet Korvus, our new open-source tool that simplifies and unifies the entire RAG pipeline into a single database query. | ||
| featured:true | ||
| tags:[product] | ||
| image:".gitbook/assets/Blog-Image_Korvus-Release.jpg" | ||
| --- | ||
| #Introducing Korvus: The All-in-One RAG Pipeline for PostgresML | ||
| <divalign="left"> | ||
| <figure><imgsrc=".gitbook/assets/image.png"alt="Author"width="100"><figcaption></figcaption></figure> | ||
| </div> | ||
| Cassandra Stumer | ||
| July 10, 2024 | ||
| You’re probably all too familiar with the complexities of building and maintaining RAG pipelines. The multiple services, the API calls, the data movement. Managing and scaling efficient infrastructure is the woefully painful and un-sexy side of building any ML/AI system. It’s also the most crucial factor when it comes to delivering real-world, production applications. That’s why we perform machine learning directly in PostgreSQL. | ||
| After hard-earned wisdom gained scaling the ML platform at Instacart, our team is bullish on in-database machine learning winning out as the AI infrastructure of the future. We know from experience that moving the compute to your database is far more efficient, effective and scalable than continuously moving your data to the models. That’s why we built PostgresML. | ||
| While we’re big Postgres fans, we asked ourselves: what if we could simplify all of that for folks who need a robust, production-grade RAG pipeline, but aren’t into SQL? Korvus is our answer. It's an extension of what we've been doing with PostgresML, but abstracts away the complexity of SQL-based operations. That way, more builders and users can reap the benefits of a unified, in-database RAG pipeline. | ||
| Why is RAG better with Korvus? Korvus provides a high-level interface in multiple programming languages that unifies the entire RAG pipeline into a single database query. Yes, you read that right - one query to handle embedding generation, vector search, reranking, and text generation. <i>One query to rule them all</i>. | ||
| Here's what's under the hood: Korvus’ core operations are built on optimized SQL queries. You’ll get high-performance, customizable search capabilities with minimal infrastructure concerns – and you can do it all in Python, JavaScript or Rust. | ||
| !!! info | ||
| Open a[GitHub issue](https://github.com/postgresml/korvus/issues) to vote on support for another language and we will add it to our roadmap. | ||
| !!! | ||
| Performing RAG directly where your data resides with optimized queries not only produces a faster app for users; but also gives you the ability to inspect, understand, and even customize these queries if you need to. | ||
| Plus, when you build on Postgres, you can leverage its vast ecosystem of extensions. The capabilities are robust; “just use Postgres” is a common saying for a reason. There’s truly an extension for everything, and extensions like pgvector, pgml and pgvectorscale couple all the performance and scalability you'd expect from Postgres with sophisticated ML/AI operations. | ||
| We're releasing Korvus as open-source software, and yes, it can run locally in Docker for those of you who like to tinker. In our (admittedly biased) opinion – it’s easiest to run Korvus on our serverless cloud. The PostgresML cloud comes with GPUs, and it’s preloaded with the extensions you’ll need to get started. Plus, you won’t have to manage a database. | ||
| Once set up locally or in the PostgresML cloud, getting started with Korvus is easy! | ||
| !!! generic | ||
| !!! code_block | ||
| ```python | ||
| from korvusimport Collection, Pipeline | ||
| from richimportprint | ||
| import asyncio | ||
| # Initialize our Collection | ||
| collection= Collection("semantic-search-demo") | ||
| # Initialize our Pipeline | ||
| # Our Pipeline will split and embed the `text` key of documents we upsert | ||
| pipeline= Pipeline( | ||
| "v1", | ||
| { | ||
| "text": { | ||
| "splitter": {"model":"recursive_character"}, | ||
| "semantic_search": { | ||
| "model":"mixedbread-ai/mxbai-embed-large-v1", | ||
| }, | ||
| }, | ||
| }, | ||
| ) | ||
| asyncdefmain(): | ||
| # Add our Pipeline to our Collection | ||
| await collection.add_pipeline(pipeline) | ||
| # Upsert our documents | ||
| documents= [ | ||
| { | ||
| "id":"1", | ||
| "text":"Korvus is incredibly fast and easy to use.", | ||
| }, | ||
| { | ||
| "id":"2", | ||
| "text":"Tomatoes are incredible on burgers.", | ||
| }, | ||
| ] | ||
| await collection.upsert_documents(documents) | ||
| # Perform RAG | ||
| query="Is Korvus fast?" | ||
| print(f"Querying for response to:{query}") | ||
| results=await collection.rag( | ||
| { | ||
| "CONTEXT": { | ||
| "vector_search": { | ||
| "query": { | ||
| "fields": {"text": {"query": query}}, | ||
| }, | ||
| "document": {"keys": ["id"]}, | ||
| "limit":1, | ||
| }, | ||
| "aggregate": {"join":"\n"}, | ||
| }, | ||
| "chat": { | ||
| "model":"meta-llama/Meta-Llama-3-8B-Instruct", | ||
| "messages": [ | ||
| { | ||
| "role":"system", | ||
| "content":"You are a friendly and helpful chatbot", | ||
| }, | ||
| { | ||
| "role":"user", | ||
| "content":f"Given the context\n:{{CONTEXT}}\nAnswer the question briefly:{query}", | ||
| }, | ||
| ], | ||
| "max_tokens":100, | ||
| }, | ||
| }, | ||
| pipeline, | ||
| ) | ||
| print(results) | ||
| asyncio.run(main()) | ||
| ``` | ||
| !!! | ||
| !!! results | ||
| ```json | ||
| { | ||
| 'rag': ['Yes, Korvus is incredibly fast!'], | ||
| 'sources': { | ||
| 'CONTEXT': [ | ||
| { | ||
| 'chunk': 'Korvus is incredibly fast and easy to use.', | ||
| 'document': {'id': '1'}, | ||
| 'rerank_score': None, | ||
| 'score': 0.7542821004154432 | ||
| } | ||
| ] | ||
| } | ||
| } | ||
| ``` | ||
| !!! | ||
| !!! | ||
| Give it a spin, and let us know what you think. We're always here to geek out about databases and machine learning, so don't hesitate to reach out if you have any questions or ideas. We welcome you to: | ||
| -[Join our Discord server](https://discord.gg/DmyJP3qJ7U) | ||
| -[Follow us on Twitter](https://twitter.com/postgresml) | ||
| -[Contribute to the project on GitHub](https://github.com/postgresml/korvus) | ||
| We're excited to see what you'll build with Korvus. Whether you're working on advanced search systems, content recommendation engines, or any other RAG-based application, we believe Korvus can significantly streamline your architecture and boost your performance. | ||
| Here's to simpler architectures and more powerful queries! |
Binary file addedpgml-cms/docs/.gitbook/assets/vpc.png
Loading
Sorry, something went wrong.Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
102 changes: 54 additions & 48 deletionspgml-cms/docs/SUMMARY.md
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
Oops, something went wrong.
Uh oh!
There was an error while loading.Please reload this page.
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.