Repository files navigation

taskq is brought to you by ⭐uptrace/uptrace.Uptrace is an open source and blazingly fastdistributed tracing tool poweredby OpenTelemetry and ClickHouse. Give it a star as well!

• Redis, SQS, IronMQ, and in-memory backends.
• Automatically scaling number of goroutines used to fetch (fetcher) and process messages (worker).
• Global rate limiting.
• Global limit of workers.
• Call once - deduplicating messages with same name.
• Automatic retries with exponential backoffs.
• Automatic pausing when all messages in queue fail.
• Fallback handler for processing failed messages.
• Message batching. It is used in SQS and IronMQ backends to add/delete messages in batches.
• Automatic message compression using snappy / s2.

Resources:

• Get started
• Examples
• Discussions
• Chat
• Reference

To get started, seeGolang Task Queue documentation.

Producer:

import ("github.com/vmihailenco/taskq/v3""github.com/vmihailenco/taskq/v3/redisq")// Create a queue factory.varQueueFactory=redisq.NewFactory()// Create a queue.varMainQueue=QueueFactory.RegisterQueue(&taskq.QueueOptions{Name:"api-worker",Redis:Redis,// go-redis client})// Register a task.varCountTask=taskq.RegisterTask(&taskq.TaskOptions{Name:"counter",Handler:func()error {IncrLocalCounter()returnnil    },})ctx:=context.Background()// And start producing.for {// Call the task without any args.err:=MainQueue.Add(CountTask.WithArgs(ctx))iferr!=nil {panic(err)}time.Sleep(time.Second)}

Consumer:

// Start consuming the queue.iferr:=MainQueue.Start(context.Background());err!=nil {log.Fatal(err)}

• Golang ORM for PostgreSQL, MySQL, MSSQL, and SQLite
• Golang PostgreSQL
• Golang HTTP router
• Golang ClickHouse

Thanks to all the people who already contributed!