Pgx, Gorm, Korm (Sqlite, PostgreSQL, CockroachDB) vs Tarantool cockroachdb 21.1.11 postgresql 14.0-1 tarantool 2.8.2 (because latest tagged on this version, not 2.10.4) ./clean-start.shgotest -bench=Korm -benchmem. gotest -bench=Gorm -benchmem. gotest -bench=Taran -benchmem. gotest -bench=Pgx -benchmem. 2023-01-14 Result 10K rows, GetAll select all rows, concurrency: 32 goos: linux, goarch: amd64 S = struct, M = map, A = array disabled cache for KORM tarantool 10x less rps when only 1 core utilized (withoutconc) ## korm 1.3.8## gorm 1.24.3## go-tarantool 1.10.0InsertS_Cockroach_Gorm-32 10000 163963 ns/op 1.64 s InsertS_Cockroach_Korm-32 10000 434172 ns/op 4.34 sInsertS_Postgres_Gorm-32 10000 154924 ns/op 1.55 sInsertS_Postgres_Korm-32 10000 163079 ns/op 1.63 sInsertS_Sqlite_Gorm-32 10000 1234051 ns/op 12.34 sInsertS_Sqlite_Korm-32 10000 2050994 ns/op 20.51 sInsertS_Taran_ORM-32 10000 29680 ns/op 0.30 sGetAllM_Cockroach_Gorm-32 1879 634957 ns/op 294824 B/op 6759 allocs/opGetAllM_Cockroach_Korm-32 722 1478724 ns/op 4278933 B/op 59979 allocs/opGetAllM_Postgres_Gorm-32 3664 316556 ns/op 570431 B/op 12983 allocs/opGetAllM_Postgres_Korm-32 1327 885765 ns/op 4036508 B/op 59714 allocs/opGetAllM_Sqlite_Gorm-32 10000 431210 ns/op 1578220 B/op 35069 allocs/opGetAllM_Sqlite_Korm-32 978 1134521 ns/op 4439227 B/op 89977 allocs/opGetAllM_Taran_Raw-32 156 7777074 ns/op 4566475 B/op 69736 allocs/opGetAllS_Cockroach_Gorm-32 999 1071982 ns/op 2352898 B/op 79689 allocs/opGetAllS_Cockroach_Korm-32 715 1486551 ns/op 1992995 B/op 80002 allocs/opGetAllS_Postgres_Gorm-32 1394 730572 ns/op 2351424 B/op 79682 allocs/opGetAllS_Postgres_Korm-32 1159 1041059 ns/op 1990956 B/op 79748 allocs/opGetAllS_Sqlite_Gorm-32 1047 1063228 ns/op 2828802 B/op 139728 allocs/opGetAllS_Sqlite_Korm-32 736 1477125 ns/op 2393110 B/op 119993 allocs/opGetAllS_Taran_Raw-32 156 7687067 ns/op 1446471 B/op 59736 allocs/opGetRowM_Cockroach_Gorm-32 15852 74238 ns/op 64219 B/op 467 allocs/opGetRowM_Cockroach_Korm-32 32973 35975 ns/op 1695 B/op 43 allocs/opGetRowM_Postgres_Gorm-32 25344 45178 ns/op 23940 B/op 208 allocs/opGetRowM_Postgres_Korm-32 70509 15877 ns/op 1695 B/op 42 allocs/opGetRowM_Sqlite_Gorm-32 72108 16634 ns/op 4817 B/op 110 allocs/opGetRowM_Sqlite_Korm-32 323451 3202 ns/op 1432 B/op 45 allocs/opGetRowM_Taran_Raw-32 160676 7275 ns/op 2425 B/op 51 allocs/opGetRowS_Cockroach_Gorm-32 20312 61121 ns/op 71997 B/op 512 allocs/opGetRowS_Cockroach_Korm-32 9338 170849 ns/op 2687 B/op 71 allocs/opGetRowS_Postgres_Gorm-32 26478 46250 ns/op 23897 B/op 202 allocs/opGetRowS_Postgres_Korm-32 10000 137373 ns/op 2682 B/op 71 allocs/opGetRowS_Sqlite_Gorm-32 70897 16205 ns/op 4183 B/op 92 allocs/opGetRowS_Sqlite_Korm-32 117987 12081 ns/op 2148 B/op 64 allocs/opGetRowS_Taran_ORM-32 298116 3726 ns/op 1057 B/op 24 allocs/opGetRowS_Taran_Raw-32 161505 7447 ns/op 2425 B/op 51 allocs/op2023-01-15 Result 100K rows, GetAll select 1000 rows unordered, concurrency: 32 SQLite = too slow Gorm = too many errors, connection reset by peer Korm = failed update postgres tests ## korm 1.4.1## pgx 5.2.0## go-tarantool 1.10.0InsertS_Cockroach_Korm-32 100000 451436 ns/op 45.14 sInsert_Cockroach_Pgx-32 100000 99197 ns/op 9.92 sInsertS_Postgres_Korm-32 100000 172047 ns/op 17.20 sInsert_Postgres_Pgx-32 100000 56311 ns/op 5.63 sInsertS_Taran_ORM-32 100000 36685 ns/op 3.67 s -- fastestUpdate_Cockroach_Korm-32 200000 48294 ns/op 9.66 sUpdate_Cockroach_Pgx-32 200000 248171 ns/op 49.63 sUpdate_Postgres_Pgx-32 200000 50967 ns/op 10.19 sUpdate_Taran_ORM-32 200000 221 ns/op 0.04 s -- fastestGetAllM_Cockroach_Korm-32 8346 132151 ns/op 417864 B/op 5972 allocs/opGetAllM_Postgres_Korm-32 12662 93979 ns/op 391546 B/op 5716 allocs/op -- fastestGetAllM_Taran_Raw-32 1640 742542 ns/op 1248536 B/op 6731 allocs/opGetAllS_Cockroach_Korm-32 5997 200701 ns/op 167815 B/op 7999 allocs/opGetAllS_Cockroach_Pgx-32 16476 73736 ns/op 58497 B/op 2951 allocs/opGetAllS_Postgres_Korm-32 7095 166231 ns/op 165827 B/op 7752 allocs/opGetAllS_Postgres_Pgx-32 40404 30255 ns/op 58503 B/op 2967 allocs/op -- fastestGetAllS_Taran_ORM-32 4180 291447 ns/op 233928 B/op 4714 allocs/opGetAllS_Taran_Raw-32 1689 734751 ns/op 936548 B/op 5731 allocs/opGetAllA_Taran_ORM-32 4146 286855 ns/op 157546 B/op 4703 allocs/opGetRowM_Cockroach_Korm-32 51686 23119 ns/op 1759 B/op 44 allocs/opGetRowM_Postgres_Korm-32 93655 12851 ns/op 1759 B/op 44 allocs/opGetRowM_Taran_Raw-32 130099 8951 ns/op 2498 B/op 55 allocs/op -- fastestGetRowS_Cockroach_Korm-32 9432 157098 ns/op 2729 B/op 71 allocs/opGetRowS_Cockroach_Pgx-32 78200 14916 ns/op 621 B/op 15 allocs/opGetRowS_Postgres_Korm-32 10000 137250 ns/op 2724 B/op 71 allocs/opGetRowS_Postgres_Pgx-32 226089 5308 ns/op 619 B/op 15 allocs/opGetRowS_Taran_ORM-32 297463 3724 ns/op 1058 B/op 24 allocs/op -- fastestGetRowS_Taran_Raw-32 113793 10017 ns/op 2509 B/op 56 allocs/op2023-01-18 100K Rows, GetAll Select 1000 Rows ordered, concurrency: 32 korm still failed for postgres-update benchmark BenchmarkUpdate_Postgres_Korm korm return error when failed to set cache, so have to check for map.ErrLargeData enable korm cache but limit to 1MB, since it would make realistic benchmark for cases when database multitude times larger than RAM size ## korm 1.4.3## pgx 5.2.0## go-tarantool 1.10.0GetAllA_Taran_ORM-32 3799 294895 ns/op 157528 B/op 4702 allocs/op GetAllM_Cockroach_Korm-32 7966 136781 ns/op 417854 B/op 5972 allocs/opGetAllM_Postgres_Korm-32 12549 96720 ns/op 391705 B/op 5734 allocs/op -- fastestGetAllM_Taran_Raw-32 1560 778315 ns/op 1248589 B/op 6733 allocs/op GetAllS_Cockroach_Korm-32 5606 209751 ns/op 167810 B/op 8000 allocs/opGetAllS_Cockroach_Pgx-32 14605 81561 ns/op 58492 B/op 2951 allocs/opGetAllS_Postgres_Korm-32 6732 167764 ns/op 165970 B/op 7770 allocs/opGetAllS_Postgres_Pgx-32 37880 32951 ns/op 59516 B/op 2996 allocs/op -- fastestGetAllS_Taran_ORM-32 3889 298250 ns/op 233923 B/op 4714 allocs/opGetAllS_Taran_Raw-32 1372 779119 ns/op 936611 B/op 5735 allocs/op GetRowM_Cockroach_Korm-32 51204 23929 ns/op 1759 B/op 44 allocs/opGetRowM_Postgres_Korm-32 93279 13097 ns/op 1760 B/op 44 allocs/opGetRowM_Taran_Raw-32 132504 8602 ns/op 2556 B/op 57 allocs/op -- fastest GetRowS_Cockroach_Korm-32 9536 141470 ns/op 2756 B/op 72 allocs/opGetRowS_Cockroach_Pgx-32 81296 14748 ns/op 619 B/op 15 allocs/opGetRowS_Postgres_Korm-32 10000 117153 ns/op 2755 B/op 72 allocs/opGetRowS_Postgres_Pgx-32 199897 6032 ns/op 619 B/op 15 allocs/opGetRowS_Taran_ORM-32 304686 3676 ns/op 1114 B/op 26 allocs/op -- fastestGetRowS_Taran_Raw-32 112923 9554 ns/op 2570 B/op 58 allocs/op Insert_Cockroach_Pgx-32 100000 96523 ns/op 9.65 sInsert_Postgres_Pgx-32 100000 53829 ns/op 5.38 sInsertS_Cockroach_Korm-32 100000 121974 ns/op 12.19 sInsertS_Postgres_Korm-32 100000 85382 ns/op 8.54 sInsertS_Taran_ORM-32 100000 31075 ns/op 3.11 s -- fastest Update_Cockroach_Korm-32 200000 35877 ns/op 7.18 sUpdate_Cockroach_Pgx-32 200000 283554 ns/op 56.71 sUpdate_Postgres_Pgx-32 200000 53921 ns/op 10.78 sUpdate_Taran_ORM-32 200000 179 ns/op 0.04 s -- fastestTo be fair with korm that optimized for cases when database data size is smaller than RAM (cache set to 100MB)
BenchmarkGetAllM_Cockroach_Korm-32 2105178 546.8 ns/op 32 B/op 2 allocs/opBenchmarkGetAllM_Postgres_Korm-32 2171280 568.3 ns/op 32 B/op 2 allocs/opBenchmarkGetAllS_Cockroach_Korm-32 1852326 682.0 ns/op 256 B/op 3 allocs/opBenchmarkGetAllS_Postgres_Korm-32 1690938 703.8 ns/op 256 B/op 3 allocs/opBenchmarkGetRowM_Cockroach_Korm-32 52078 19679 ns/op 1655 B/op 38 allocs/opBenchmarkGetRowM_Postgres_Korm-32 92900 11864 ns/op 1819 B/op 42 allocs/opBenchmarkGetRowS_Cockroach_Korm-32 9546 140996 ns/op 3004 B/op 73 allocs/opBenchmarkGetRowS_Postgres_Korm-32 7900 133152 ns/op 3005 B/op 73 allocs/opBenchmarkInsertS_Postgres_Korm-32 100000 84714 ns/op 8.47 sBenchmarkUpdate_Cockroach_Korm-32 200000 33460 ns/op 6.69 sTarantool fastest for insert, update, get single row use-case, postgres with pgx fastest for get multi-row use-case.