Instantly share code, notes, and snippets.
- Star(2,525)
You must be signed in to star a gist - Fork(258)
You must be signed in to fork a gist
Save cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb to your computer and use it in GitHub Desktop.
- Simplify: move code into database functions
- Just Use Postgres for Everything
- Just use Postgres
- PostgreSQL is the worlds’ best database
- Postgres is eating the database world
- Hacker News discussion
- https://github.com/citusdata/pg_cron
- https://github.com/cybertec-postgresql/pg_timetable
- https://github.com/crunchydata/pg_incremental
- https://adriano.fyi/posts/2023-09-24-choose-postgres-queue-technology
- https://github.com/tembo-io/pgmq
- https://github.com/arkhipov/temporal_tables
- https://github.com/supabase/supa_audit
- https://github.com/pgMemento/pgMemento
- https://github.com/pgaudit/pgaudit
- https://github.com/arkhipov/acl
- https://www.postgresql.org/docs/current/pgcrypto.html
- https://github.com/michelp/pgjwt
- https://supabase.com/docs/guides/database/vault
- https://github.com/pgvector/pgvector
- Vecto: Hybrid Search with Postgres (pgvector) and Elixir (Ecto)
- Postgres Full Text Search (bunch of helpful links)
- https://github.com/paradedb/paradedb
- https://github.com/postgresml
- https://github.com/paradedb/paradedb/tree/dev/pg_analytics
- https://github.com/paradedb/paradedb/tree/dev/pg_lakehouse
- https://github.com/hydradatabase/hydra
- https://github.com/citusdata/cstore_fdw
- https://github.com/microsoft/documentdb
- https://www.ferretdb.com
- https://github.com/event-driven-io/Pongo
- https://www.postgresql.org/docs/current/datatype-json.html
- https://github.com/robconery/dox
- https://github.com/PostgREST/postgrest
- https://github.com/hasura/graphql-engine
- https://postgraphile.org
- https://supabase.github.io/pg_graphql
- https://www.postgresql.org/docs/current/sql-notify.html
- https://github.com/cpursley/walex (subscribe to Postgres WAL events - powersAppraisal Inbox)
- https://github.com/PeerDB-io/peerdb
- https://github.com/debezium/debezium
- https://github.com/2ndQuadrant/pglogical
- https://github.com/purcell/postgresql-migrations
- https://www.bytebase.com/
- https://github.com/xataio/pgroll
- https://github.com/stripe/pg-schema-diff
- https://github.com/nexsol-technologies/pgassistant
- Index Advisor
- Dexter
- HypoPG
- pg_hint_plan
- PGHero
- https://codeberg.org/Data-Bene/StatsMgr
jherazob commentedFeb 8, 2024
@jherazob what are you thoughts on this approach?:Supabase Vault
I'm only vaguely aware of the existence of Supabase and have never really evaluated it before, so will have to give it a good look before forming an opinion, gut feeling still tells me that secrets on the DB is probably not good but i have to analyze their approach to give it a fair assessment
arjunlol commentedFeb 9, 2024
@cpursley something that can be added to Audit Logs:https://github.com/BemiHQ/bemi
StephanSchmidt commentedFeb 9, 2024 • edited
Loading Uh oh!
There was an error while loading.Please reload this page.
edited
Uh oh!
There was an error while loading.Please reload this page.
Great! That this idea is getting traction :-)
kenfar commentedFeb 12, 2024 • edited
Loading Uh oh!
There was an error while loading.Please reload this page.
edited
Uh oh!
There was an error while loading.Please reload this page.
This is missing data warehousing, reporting and analytics.
cpursley commentedFeb 12, 2024
@kenfar Any suggestions for those?
LrWm3 commentedFeb 12, 2024
@cpursley@kenfar its deprecated but technically tobs can be salveged for this purpose:https://github.com/timescale/tobs
kenfar commentedFeb 12, 2024
@cpursley - no product is needed, just the right features:
- partitioning
- query parallelism
- dimensional model (rather than say one-big-table)
- pre-computed aggregate tables for common queries
- appropriate hardware (sufficient memory, cpu, maybe very fast IO)
This is missing an MPP configuration (data distributed across multiple servers working together on queries), and columnar structures. But, those aren't absolutely essential.
mjf commentedFeb 13, 2024 • edited
Loading Uh oh!
There was an error while loading.Please reload this page.
edited
Uh oh!
There was an error while loading.Please reload this page.
MyPostgres collection, perhaps you'd like to use some of the items as well. Here is my list ofPostgres blogs worth visiting regularly.
cpursley commentedFeb 13, 2024 • edited
Loading Uh oh!
There was an error while loading.Please reload this page.
edited
Uh oh!
There was an error while loading.Please reload this page.
These are great@mjf, thanks! I added a link undermiscellaneous.
brianheineman commentedFeb 14, 2024 • edited
Loading Uh oh!
There was an error while loading.Please reload this page.
edited
Uh oh!
There was an error while loading.Please reload this page.
I've recently put together the Rust cratepostgresql-embedded that will allow you to embed PostgreSQL into an executable for use in environments where downloading the installation may not be an option.
WesleyYue commentedFeb 14, 2024
@cpursley@kenfar checkouthttps://github.com/hydradatabase/hydra andhttps://github.com/paradedb/paradedb for analytics/column stores.
mahrous-amer commentedMar 22, 2024
I have been usinghttps://github.com/sqitchers/sqitch for a while on production to handle migrations with Postgres it works perfectly.
docwhat commentedMay 21, 2024
https://graphjin.com for purely GraphQL API goodness?
philippemnoel commentedMay 21, 2024
For analytics:
pg_lakehouse (by ParadeDB):https://github.com/paradedb/paradedb/tree/dev/pg_lakehouse -- Fast analytics from Postgres over local Parquet files, data lakes (S3, GCS, etc.), and lakehouses (Delta Lake, Iceberg)
pg_analytics (by ParadeDB):https://github.com/paradedb/paradedb/tree/dev/pg_analytics -- Columnar storage in Postgres for fast analytics inside Postgres tables
AdnanSoftic commentedJul 11, 2024 • edited
Loading Uh oh!
There was an error while loading.Please reload this page.
edited
Uh oh!
There was an error while loading.Please reload this page.
For NoSQL:
Mdkar commentedJul 16, 2024
Not sure if it’s any good, butPostgresML claims to do RAG infra (for use with LLMs and chat bots).
secp256k1-sha256 commentedJul 17, 2024
Amazing list, very helpful.
Scaling section can be improved further.
Connection Pools and Load balancers: (similar to Supavisor added by you)
PgCat
PgBouncer
PgPool-II
Sharding:
Citus can be under scaling as well due tosharding capability.
I am not sure below Postgres derivatives can be part of the list as they are not open source but they are part of Postgres compatible scaling solutions.
Distributed Postgres flavors:
Yugabyte
Multi-master Postgres derivatives for scaling :
Spock
EDB Postgres-distributed
AWS PGACTIVE
CC-Hsu commentedJul 25, 2024
I'd like to know how postgres can join to the blockchain world since this is a less discussed topic.
cassandrastumer commentedAug 21, 2024
For scaling:https://github.com/postgresml/pgcat
For search:https://github.com/postgresml
For RAG/ML/AI:https://github.com/postgresml
abeisleem commentedAug 25, 2024
recommend addinghttps://anyblockers.com/posts/postgres-as-a-search-engine under #Search
gregdingle commentedJan 14, 2025
Edgedb should be in there somewhere.
bkovacev commentedJan 14, 2025
I would love to see some self hosting best practices and gotchas!
xenophenes commentedJan 15, 2025
https://codeberg.org/Data-Bene/StatsMgr was just introduced as advanced statistics management
ityler commentedFeb 12, 2025
GIS/Mapping:https://github.com/pgRouting
rodafr commentedFeb 13, 2025
Cloud native Postgres:https://cloudnative-pg.io/
divyam234 commentedFeb 13, 2025
Worth mentioning pgroonga for advanced multilingual searchhttps://pgroonga.github.io/
varun-dhawan commentedJun 30, 2025
Great repo -@cpursley !!
I’d suggest adding this 5-part blog series onadvanced data science with PostgreSQL window functions:
https://data-nerd.blog/tag/window-functions/
Coversranking,rolling stats,gaps/islands, and more—pure SQL, no external tooling. Could fit underAnalytics or Advanced SQL with PostgreSQL.
maelp commentedNov 6, 2025
This is interesting toohttps://www.malloydata.dev/ andhttps://github.com/malloydata/malloy
maelp commentedNov 6, 2025
Also DBOS and Absurd
https://github.com/dbos-inc/
https://github.com/earendil-works/absurd
alice-viola commentedNov 17, 2025
I'm the author ofQueenMQ, a C++ queue system backed by Postgres; we replaced Kafka with it in some of our B2B SaaS products.