- Notifications
You must be signed in to change notification settings - Fork15
Instantly create video clips from LLM prompts
License
NotificationsYou must be signed in to change notification settings
video-db/PromptClip
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
Create video clips using LLM prompts
🐞Report a Bug ·💡Suggest a Feature
It allows any developer to:
- 📚 Upload a video from any source (Local Files, Youtube, S3 etc.)
- 🔍 Prompt that video in natural language with queries like
Show funny moments in the videoorfind the moments useful for social media trailer - 🎛️ Use any LLM of your choice like OpenAI, Claude or Gemeni Pro.
- 🌟 Instantly watch the clip of those moments.
- 🛠️ Finetune the clip or supercut by ranking results, managing length of the clip etc.
- 🎸 Add music or image overlay to the clip.
Checkout these prompts and the results 👉🏼
| Original Video | Prompt | Link |
|---|---|---|
| Shark Tank | Find every moment where a deal was offered | watch |
| Useful Gadgets | Show me moments in the video where the host discusses or reveals the pricing of the gadgets | watch |
| Sponsorship Details of Huberman Podcast | Find details about every sponsor | watch |
| Highlights from Masterchef Episode | Show me the feedback from every judge | watch |
| Important Topics/Advice from a Lecture | Find sentences where anxiety is discussed | watch |
| Tech Review Video | Find sentences where host explains about the battery | watch |
| Travel Video | What are some popular tourist destinations in Sri Lanka | watch |
- Get your API key: Sign up onVideoDB console (Free for the first 50 uploads, nocredit card required). 🆓
- Set
VIDEO_DB_API_KEY: Enter your key in theenvfile. - Set
OPENAI_API_KEYorANTHROPIC_KEY: Add your LLM API Key in theenvfile. - Install dependencies: Run
pip install -r requirements.txtin your terminal. - Run locally: Run the notebook
PromptClip_text.ipynb,PromptClip_visual.ipynbandPromptClip_multimodal.ipynbto experiment with your prompts and ranking of results.
- Add support for music generation models to jazzup the cuts.
- Integrate with other projects like Pika Labs and Midjourney.
Your contributions make the open-source community an incredible place for learning, inspiration, and creativity. Wewelcome and appreciate your input! Here's how you can contribute:
- Open issues to share your use cases.
- Participate in brainstorming solutions for our roadmap.
- Suggest improvements to the codebase.
- Fork the Project 🍴
- Create your Feature Branch (
git checkout -b feature/AmazingFeature) - Commit your Changes (
git commit -m 'Add some AmazingFeature') - Push to the Branch (
git push origin feature/AmazingFeature) - Open a Pull Request 📬