Movatterモバイル変換


[0]ホーム

URL:


Sorry, we no longer support your browser
Please upgrade toMicrosoft Edge,Google Chrome, orFirefox. Learn more about ourbrowser support.
Skip to main content

Stack Exchange Network

Stack Exchange network consists of 183 Q&A communities includingStack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange
Loading…
Software Engineering

Questions tagged [apache-kafka]

Ask Question

Apache Kafka is publish-subscribe messaging rethought as a distributed commit log.

99 questions
Filter by
Sorted by
Tagged with
5votes
3answers
1kviews

I was trying to model a fairly simple real world model inside a distributed system and got stuck thinking about timing and order and would appreciate some external view on it.Assuming I have this ...
3votes
1answer
169views

I am currently working in a project where we are utilizing kafka as a Message Queue. We have two use cases here, one is to consume the messages in parallel, no ordering of any kind required. And one ...
0votes
1answer
347views

I am designing a message processing system for Kafka topic A.Each message has a message_type and needs to query DB to determine the tasks required for this message_type. The tasks are independent of ...
kietheros's user avatar
0votes
0answers
195views

In RabbitMQ streams or Kafka, messages are not deleted after being consumed. If you have a consumer application replicated across multiple Kubernetes pods, how can you ensure that each pod picks up a ...
-2votes
1answer
237views

I am currently developing a microservices architecture consisting of two services, and I'm facing a challenge related to transaction management and error handling.Microservice A: This service is ...
1vote
1answer
159views

Context:We have 2 services - a user-facing API server and a background processing Kafka worker.Both of these are hosted on AWS EKS, and we use AWS MSK for Kafka.The job of the API server is to ...
Sidharth Samant's user avatar
3votes
2answers
454views

I have an application using Hexagonal Architecture. I want to implement a DLQ in 2 scenarios:When the event streaming adapter's incoming message is unreadable (invalid payload, etc)When the domain ...
Ryan's user avatar
  • 133
0votes
2answers
171views

I'm not encountering any issue in prod or anything, I'm just reading about Kafka and I'm curious about this case.As I understand,A producer sends messages to the leader.The replicas copy the ...
Thomas's user avatar
1vote
1answer
106views

I'm struggling to (integration) test a component that makes use of an infinite generator.Background:At a really high level, this component is essentially a "middleman" in a kafka workflow. ...
0votes
1answer
123views

I want to collect a lot of files (file data + metadata) from local servers to a central server. Files are important, need to ensure that no files are lostLocal servers: implement a collector to ...
kietheros's user avatar
0votes
2answers
244views

I've been at my current job for about 4-5 months, mainly working with Go, and I have no prior experience with Kafka. Before this, my background was in JavaScript, Node.js, React, etc. I recently got a ...
Anatoly's user avatar
2votes
2answers
1kviews

Let’s say I have a booking microservice (single instance) with its own DB.If I want to horizontally scale the service with multiple instances(exact same copy of the business logic code) running on ...
2votes
2answers
196views

Folks,I am wondering if there is any dis/advantage to using json objects as message keys.Assume I have 2 event streams coupled with 2 tables in a source system. Each of those tables have its own ...
Babak's user avatar
1vote
1answer
169views

I would like to have a series of small stand-alone services that would either consume a Kafka topic and output the data into a different system or the reverse: receive data from a system and produce ...
mparada's user avatar
1vote
1answer
511views

We want to install Kafka Kraft cluster on 35 machines ( machines are DELL physical machines - type R760 And OS is Linux RHEL 8.6 version )Since we are dealing with Kafka production cluster , we want ...
jessica's user avatar

153050per page
1
2345
7

Hot Network Questions

more hot questions
Newest apache-kafka questions feed

[8]ページ先頭

©2009-2025 Movatter.jp