361 questions
- Bountied 0
- Unanswered
- Frequent
- Score
- Trending
- Week
- Month
- Unanswered (my tags)
1
vote
1
answer
58
views
How to access topic/payload in PulsarMessage since it has private getters in apache beam pulsar io connector 2.69.0
I noticed that the class PulsarMessage has private getters in version 2.69.0. Shouldn't they be public inorder to access the topics names and/or payload of the message. Artifact link : https://...
0
votes
0
answers
40
views
Message queue where each key is processed by only one consumer at a time, but other messages for the same key can be assigned to other consumers
I'm building a distributed system that processes messages from hundreds of thousands of sensors, each identified by a sensor_id.
I need to guarantee:
Strict ordering per sensor_id
No two consumers ...
0
votes
1
answer
54
views
Apache Pulsar cannot bind when using multiple listeners
I am using the example compose from: https://pulsar.apache.org/docs/4.0.x/getting-started-docker-compose/
and following the steps described at: https://pulsar.apache.org/docs/4.0.x/concepts-multiple-...
1
vote
1
answer
58
views
Spring Pulsar: Missing spring-pulsar-spring-cloud-stream-binder dependency
Problem
I'm setting up a Spring Boot application with Apache Pulsar integration using Spring Cloud Stream. When trying to build my project, I'm getting the following error:
auth-service:main: Could ...
1
vote
0
answers
66
views
How to perform Geo-Replication in Apache Pulsar without creating duplicate messages?
I’m designing a multi-datacenter architecture using Apache Pulsar with geo-replication enabled.
Architecture Overview:
Apache Pulsar version: 4.0.2
Helm Chart version: pulsar-3.9.0
BookKeeper: 5 ...
0
votes
0
answers
103
views
Cannot find module '[email protected]' by pnpm
I tried to migrate an old project from NPM to PNPM, but after running pnpm install, when I try to start the project, I encounter a MODULE_NOT_FOUND error. How can I fix this issue?
node:internal/...
0
votes
0
answers
34
views
How to set maxRedeliveryCount in apache pulsar with out configuring DLQ
I want to set maxRedeliveryCount in apache pulsar without configuring any DLQ. Since, I don't need any functionality to store msgs in DLQ. How can I do this?
I couldn't find any config related to this ...
1
vote
0
answers
90
views
Kafka on Pulsar (KoP) has been archived. What are the good solutions to enable Pulsar to support the Kafka protocol in higher versions?
Kafka on Pulsar (KoP), which was a solution enabling Pulsar to support the Kafka protocol, has now been archived. This means that the active development and maintenance of KoP may have ceased. For ...
0
votes
1
answer
71
views
Ingest data from Apache Pulsar to Apache Pinot Table not working
I am following the tutorial of the Apache Pinot and trying to set up a REALTIME table to ingest data from the Apache Pulsar topic to a Pinot table. However, I see no data injected into the table with ...
0
votes
0
answers
67
views
Pulsar docker is getting killed
I'm checking Apache Pulsar performance.
After ~10min the container gets killed.
No Errors in the container log. The last line of the log:
7 Killed - bin/pulsar standalone
The metrics of CPU/MEM not ...
-1
votes
1
answer
210
views
Apache Pulsar Broker initialization error due to initContainer test failure
I'm deploying Apache Pulsar via Helm chart, v3.8.0 (latest at this time).
The K8s cluster is on EKS, deployment via ArgoCD.
It fails to initialize the Broker (and Proxy, which depend on Broker).
The ...
0
votes
1
answer
100
views
Getting number of partitions of a Pulsar topic: could not be parsed into a proper Uri, missing scheme
I'm unable to get the number of partitions from a topic via the PulsarAdmin API:
val admin: PulsarAdmin =
PulsarAdmin
.builder()
....
1
vote
0
answers
88
views
Pulsar Reader seek for topics with partitions
TLDR; How is
void seek(Function<String,Object> function)
throws PulsarClientException
in the pulsar reader API expected to be used?
-- More info
I'd like to read messages from a pulsar topic ...
-1
votes
1
answer
362
views
Can I automatically delete/clear Pulsar topics when there are no more consumers?
I'm making a multiplayer game in Go. When you enter a room name, it will connect to a Pulsar topic with that name. When you enter a player name, it creates a subscription to that topic with that name. ...
0
votes
1
answer
121
views
Feed the result of one query to another in the same Spark Structured Streaming app
I have just started working on Spark Structured Streaming and came up with an implementation question.
So I am using Apache Pulsar to stream data, and wanted to know if it is possible to run different ...