prompt-engineering

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

open-source playground monitoring analytics evaluation self-hosted ycombinator openai observability autogen large-language-models llm prompt-engineering langchain llmops llama-index prompt-management llm-evaluation llm-observability

UpdatedJul 18, 2025
TypeScript

dottxt-ai /outlines

Star12.1k

Structured Outputs

json regex cfg symbolic-ai prompt-engineering llms generative-ai structured-generation

UpdatedJul 18, 2025
Python

comet-ml /opik

Star11.5k

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

open-source playground openai llm prompt-engineering langchain llmops llama-index llm-evaluation llm-observability

UpdatedJul 18, 2025
Python

EmbraceAGI /awesome-chatgpt-zh

Star11.2k

ChatGPT 中文指南🔥，ChatGPT 中文调教指南，指令指南，应用开发指南，精选资源清单，更好的使用 chatGPT 让你的生产力 up up up! 🚀

awesome tools ai prompt agi openai awesome-list deeplearning gpt claude gpt-4 prompt-engineering chatgpt chat-gpt langchain chatgpt3 openai-chatgpt chatgpt35-turbo chatglm

UpdatedNov 5, 2024
Python

microsoft /promptflow

Star10.6k

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

ai prompt gpt ai-applications ai-application-development llm prompt-engineering chatgpt

UpdatedJul 15, 2025
Python

langgptai /LangGPT

Star10.3k

LangGPT: Empowering everyone to become a prompt expert!🚀 Structured Prompt，Language of GPT, 结构化提示词，结构化Prompt, Created by 「云中江树」

framework deeplearning gpt3-prompts gpt-4 prompt-engineering chatgpt langgpt

UpdatedJun 7, 2025
Jupyter Notebook

linshenkx /prompt-optimizer

Star10k

一款提示词优化器，助力于编写高质量的提示词

prompt prompt-toolkit prompt-tuning llm prompt-engineering prompt-optimization

UpdatedJul 18, 2025
TypeScript

humanlayer /12-factor-agents

Star9.5k

What are the principles we can use to build LLM-powered software that is actually good enough to put in the hands of production customers?

framework ai memory orchestration agents 12-factor rag prompt-engineering llms context-window 12-factor-agents

UpdatedJul 17, 2025
TypeScript

LouisShark /chatgpt_system_prompt

Star9.4k

A collection of GPT system prompts and various prompt injection/leaking knowledge.

prompt gpt prompt-engineering

UpdatedJul 18, 2025
HTML

Portkey-AI /gateway

Star9k

A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

router gateway openai hacktoberfest prompt-engineering llms generative-ai langchain llmops llama-index ai-gateway

UpdatedJul 18, 2025
TypeScript

elder-plinius /CL4R1T4S

Star8.1k

AI SYSTEMS TRANSPARENCY FOR ALL! - LEAKED SYSTEM PROMPTS FOR CHATGPT, GEMINI, GROK, CLAUDE, PERPLEXITY, CURSOR, WINDSURF, DEVIN, REPLIT, AND MORE!

google tools ai system prompt hacking gemini openai transparency leak agents grok red-team prompts leaked system-info red-teaming prompt-engineering chatgpt system-prompts

UpdatedJul 13, 2025

asgeirtj /system_prompts_leaks

Star7.7k

Collection of extracted System Prompts from popular chatbots like ChatGPT, Claude & Gemini

ai gemini openai chatbots prompts claude google-deepmind large-language-models llm prompt-engineering generative-ai chatgpt prompt-injection anthropic

UpdatedJul 17, 2025
JavaScript

Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

testing ci evaluation ci-cd pentesting cicd vulnerability-scanners prompts evaluation-framework red-teaming rag llm prompt-engineering llmops prompt-testing llm-eval llm-evaluation llm-evaluation-framework

UpdatedJul 18, 2025
TypeScript

jamez-bondos /awesome-gpt4o-images

Star6.6k

Awesome curated collection of images and prompts generated by GPT-4o and gpt-image-1. Explore AI generated visuals created with ChatGPT and Sora, showcasing OpenAI’s advanced image generation capabilities.

openai generative-art image-generation awesome-list text-to-image prompts ai-art prompt-engineering gpt-4o curated-collection ai-image-examples ghibli-style anime-ai-art cartoon-style gpt-image-1

UpdatedMay 26, 2025
JavaScript

ai-boost /awesome-prompts

Star6.5k

Curated list of chatgpt prompts from the top-rated GPTs in the GPTs Store. Prompt Engineering, prompt attack & prompt protect. Advanced Prompt Engineering papers.

awesome prompt awesome-list papers gpts gpt4 prompt-engineering chatgpt gptstore