- Notifications
You must be signed in to change notification settings - Fork328
Silas/llama 3.2 blog post#1625
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.
Already on GitHub?Sign in to your account
Merged
Uh oh!
There was an error while loading.Please reload this page.
Merged
Changes fromall commits
Commits
Show all changes
2 commits Select commitHold shift + click to select a range
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Uh oh!
There was an error while loading.Please reload this page.
Jump to
Jump to file
Failed to load files.
Loading
Uh oh!
There was an error while loading.Please reload this page.
Diff view
Diff view
There are no files selected for viewing
1 change: 1 addition & 0 deletionspgml-cms/blog/SUMMARY.md
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
56 changes: 56 additions & 0 deletionspgml-cms/blog/meta-llama-3.2-now-available-in-postgresml-serverless.md
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,56 @@ | ||
--- | ||
description: Bringing smaller, smarter models to your data. | ||
featured: true | ||
tags: [product] | ||
image: ".gitbook/assets/Blog-Image_Llama-3.2.jpg" | ||
--- | ||
# Llama 3.2 now available in PostgresML serverless | ||
<div align="left"> | ||
<figure><img src=".gitbook/assets/image.png" alt="Author" width="100"><figcaption></figcaption></figure> | ||
</div> | ||
Cassandra Stummer | ||
September 27, 2024 | ||
Today, we're excited to announce that PostgresML now supports Llama 3.2, a development that not only enhances our capabilities, but also aligns with our core philosophy: bring the models to your data, not the other way around. | ||
## The power of smaller models | ||
The AI market is finally moving away from the "bigger is better" mentality. Size no longer equals capability. While companies like OpenAI pushed the research frontier with massive models, we're now seeing open-source models 225 times smaller achieving capabilities comparable to GPT-4 at launch. This shift challenges the notion that enormous, closed source models are the only path to advanced AI. | ||
## Why Llama 3.2 in PostgresML? | ||
Companies aiming to run their own models face a critical challenge. Data sources for interactive AI are hard to scale. The amount of context models need is growing: text, vectors, images, user history; find the needles in multiple haystacks, on demand. Gathering and sorting through context from growing data sources becomes the bottleneck in the system. | ||
As models become smaller and datasets grow larger, the traditional approach of moving data to models becomes increasingly inefficient. That’s why we've always believed that the future of AI lies in bringing models directly to your data. The integration of smaller models like Llama 3.2 into PostgresML is a testament to our vision of the future of AI: Big data and small models colocating to deliver the most efficient, scalable AI infrastructure. | ||
## What this means for you | ||
The Instruct variants, LLama 3.2 1B and 3B, are now standard models included with all Serverless Databases at **no additional cost**. You can try them now. | ||
## Getting Started | ||
Integrating Llama 3.2 with PostgresML is straightforward. Here's a quick example: | ||
```postgresql | ||
SELECT pgml.transform( | ||
task => '{ | ||
"task": "text-generation", | ||
"model": "meta-llama/Llama-3.2-3B-Instruct" | ||
}'::JSONB, | ||
inputs => Array['AI is going to'] | ||
); | ||
``` | ||
## The road ahead | ||
This is just the beginning. We're committed to continually supporting the latest and greatest models, always with the goal of making AI more efficient, and aligned with your data strategy. | ||
Ready to experience the power of Llama 3.2 in PostgresML? Get started today or contact our team for a personalized demo. | ||
Stay tuned for more updates as we continue to push the boundaries of what's possible with AI in databases\! |
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.