- Notifications
You must be signed in to change notification settings - Fork986
Replace 'hub' with 'ingest' in any GitHub URL to get a prompt-friendly extract of a codebase
License
coderamp-labs/gitingest
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
Turn any Git repository into a prompt-friendly text ingest for LLMs.
You can also replacehub withingest in any GitHub URL to access the corresponding digest.
gitingest.com ·Chrome Extension ·Firefox Add-on
Deutsch |Español |Français |日本語 |한국어 |Português |Русский |中文
- Easy code context: Get a text digest from a Git repository URL or a directory
- Smart Formatting: Optimized output format for LLM prompts
- Statistics about:
- File and directory structure
- Size of the extract
- Token count
- CLI tool: Run it as a shell command
- Python package: Import it in your code
- Python 3.8+
- For private repositories: A GitHub Personal Access Token (PAT).Generate your tokenhere!
Gitingest is available onPyPI.You can install it usingpip:
pip install gitingest
or
pip install gitingest[server]
to include server dependencies for self-hosting.
However, it might be a good idea to usepipx to install it.You can installpipx using your preferred package manager.
brew install pipxapt install pipxscoop install pipx...
If you are using pipx for the first time, run:
pipx ensurepath
# install gitingestpipx install gitingestThe extension is open source atlcandy2/gitingest-extension.
Issues and feature requests are welcome to the repo.
Thegitingest command line tool allows you to analyze codebases and create a text dump of their contents.
# Basic usage (writes to digest.txt by default)gitingest /path/to/directory# From URLgitingest https://github.com/coderamp-labs/gitingest# or from specific subdirectorygitingest https://github.com/coderamp-labs/gitingest/tree/main/src/gitingest/utils
For private repositories, use the--token/-t option.
# Get your token from https://github.com/settings/personal-access-tokensgitingest https://github.com/username/private-repo --token github_pat_...# Or set it as an environment variableexport GITHUB_TOKEN=github_pat_...gitingest https://github.com/username/private-repo# Include repository submodulesgitingest https://github.com/username/repo-with-submodules --include-submodules
By default, files listed in.gitignore are skipped. Use--include-gitignored if youneed those files in the digest.
By default, the digest is written to a text file (digest.txt) in your current working directory. You can customize the output in two ways:
- Use
--output/-o <filename>to write to a specific file. - Use
--output/-o -to output directly toSTDOUT(useful for piping to other tools).
See more options and usage details with:
gitingest --help
# Synchronous usagefromgitingestimportingestsummary,tree,content=ingest("path/to/directory")# or from URLsummary,tree,content=ingest("https://github.com/coderamp-labs/gitingest")# or from a specific subdirectorysummary,tree,content=ingest("https://github.com/coderamp-labs/gitingest/tree/main/src/gitingest/utils")
For private repositories, you can pass a token:
# Using token parametersummary,tree,content=ingest("https://github.com/username/private-repo",token="github_pat_...")# Or set it as an environment variableimportosos.environ["GITHUB_TOKEN"]="github_pat_..."summary,tree,content=ingest("https://github.com/username/private-repo")# Include repository submodulessummary,tree,content=ingest("https://github.com/username/repo-with-submodules",include_submodules=True)
By default, this won't write a file but can be enabled with theoutput argument.
# Asynchronous usagefromgitingestimportingest_asyncimportasyncioresult=asyncio.run(ingest_async("path/to/directory"))
fromgitingestimportingest_async# Use await directly in Jupytersummary,tree,content=awaitingest_async("path/to/directory")
This is because Jupyter notebooks are asynchronous by default.
Build the image:
docker build -t gitingest.Run the container:
docker run -d --name gitingest -p 8000:8000 gitingest
The application will be available athttp://localhost:8000.
If you are hosting it on a domain, you can specify the allowed hostnames via env variableALLOWED_HOSTS.
# Default: "gitingest.com, *.gitingest.com, localhost, 127.0.0.1".ALLOWED_HOSTS="example.com, localhost, 127.0.0.1"
The application can be configured using the following environment variables:
- ALLOWED_HOSTS: Comma-separated list of allowed hostnames (default: "gitingest.com, *.gitingest.com, localhost, 127.0.0.1")
- GITINGEST_METRICS_ENABLED: Enable Prometheus metrics server (set to any value to enable)
- GITINGEST_METRICS_HOST: Host for the metrics server (default: "127.0.0.1")
- GITINGEST_METRICS_PORT: Port for the metrics server (default: "9090")
- GITINGEST_SENTRY_ENABLED: Enable Sentry error tracking (set to any value to enable)
- GITINGEST_SENTRY_DSN: Sentry DSN (required if Sentry is enabled)
- GITINGEST_SENTRY_TRACES_SAMPLE_RATE: Sampling rate for performance data (default: "1.0", range: 0.0-1.0)
- GITINGEST_SENTRY_PROFILE_SESSION_SAMPLE_RATE: Sampling rate for profile sessions (default: "1.0", range: 0.0-1.0)
- GITINGEST_SENTRY_PROFILE_LIFECYCLE: Profile lifecycle mode (default: "trace")
- GITINGEST_SENTRY_SEND_DEFAULT_PII: Send default personally identifiable information (default: "true")
- S3_ALIAS_HOST: Public URL/CDN for accessing S3 resources (default: "127.0.0.1:9000/gitingest-bucket")
- S3_DIRECTORY_PREFIX: Optional prefix for S3 file paths (if set, prefixes all S3 paths with this value)
The project includes acompose.yml file that allows you to easily run the application in both development and production environments.
Thecompose.yml file uses YAML anchoring with&app-base and<<: *app-base to define common configuration that is shared between services:
# Common base configuration for all servicesx-app-base:&app-basebuild:context:.dockerfile:Dockerfileports: -"${APP_WEB_BIND:-8000}:8000"# Main application port -"${GITINGEST_METRICS_HOST:-127.0.0.1}:${GITINGEST_METRICS_PORT:-9090}:9090"# Metrics port# ... other common configurations
The file defines three services:
app: Production service configuration
- Uses the
prodprofile - Sets the Sentry environment to "production"
- Configured for stable operation with
restart: unless-stopped
- Uses the
app-dev: Development service configuration
- Uses the
devprofile - Enables debug mode
- Mounts the source code for live development
- Uses hot reloading for faster development
- Uses the
minio: S3-compatible object storage for development
- Uses the
devprofile (only available in development mode) - Provides S3-compatible storage for local development
- Accessible via:
- API: Port 9000 (localhost:9000)
- Web Console: Port 9001 (localhost:9001)
- Default admin credentials:
- Username:
minioadmin - Password:
minioadmin
- Username:
- Configurable via environment variables:
MINIO_ROOT_USER: Custom admin username (default: minioadmin)MINIO_ROOT_PASSWORD: Custom admin password (default: minioadmin)
- Includes persistent storage via Docker volume
- Auto-creates a bucket and application-specific credentials:
- Bucket name:
gitingest-bucket(configurable viaS3_BUCKET_NAME) - Access key:
gitingest(configurable viaS3_ACCESS_KEY) - Secret key:
gitingest123(configurable viaS3_SECRET_KEY)
- Bucket name:
- These credentials are automatically passed to the app-dev service via environment variables:
S3_ENDPOINT: URL of the MinIO serverS3_ACCESS_KEY: Access key for the S3 bucketS3_SECRET_KEY: Secret key for the S3 bucketS3_BUCKET_NAME: Name of the S3 bucketS3_REGION: Region for the S3 bucket (default: us-east-1)S3_ALIAS_HOST: Public URL/CDN for accessing S3 resources (default: "127.0.0.1:9000/gitingest-bucket")
- Uses the
To run the application in development mode:
docker compose --profile dev up
To run the application in production mode:
docker compose --profile prod up -d
To build and run the application:
docker compose --profile prod builddocker compose --profile prod up -d
- Create an Issue: If you find a bug or have an idea for a new feature, pleasecreate an issue on GitHub. This will help us track and prioritize your request.
- Spread the Word: If you like Gitingest, please share it with your friends, colleagues, and on social media. This will help us grow the community and make Gitingest even better.
- Use Gitingest: The best feedback comes from real-world usage! If you encounter any issues or have ideas for improvement, please let us know bycreating an issue on GitHub or by reaching out to us onDiscord.
Gitingest aims to be friendly for first time contributors, with a simple Python and HTML codebase. If you need any help while working with the code, reach out to us onDiscord. For detailed instructions on how to make a pull request, seeCONTRIBUTING.md.
- Tailwind CSS - Frontend
- FastAPI - Backend framework
- Jinja2 - HTML templating
- tiktoken - Token estimation
- posthog - Amazing analytics
- Sentry - Error tracking and performance monitoring
Check out the NPM alternative 📦 Repomix:https://github.com/yamadashy/repomix
About
Replace 'hub' with 'ingest' in any GitHub URL to get a prompt-friendly extract of a codebase
Topics
Resources
License
Code of conduct
Contributing
Security policy
Uh oh!
There was an error while loading.Please reload this page.
Stars
Watchers
Forks
Packages0
Uh oh!
There was an error while loading.Please reload this page.


