Skip to content

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Discussion] How to query the decompressed metadata from znode ? #19342

Closed
2 tasks done
kaori-seasons opened this issue Jan 28, 2023 · 1 comment
Closed
2 tasks done
Labels
Stale type/enhancement The enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages

Comments

@kaori-seasons
Copy link

kaori-seasons commented Jan 28, 2023

Search before asking

  • I searched in the issues and found nothing similar.

Motivation

Hi community. I'm targeting PIP-123 interest. I spent two weeks at work doing some tuning research.

Solution

The mechanism I understand that needs to be modified is this: call the java program in the zookeeper-shell to pass in some command line parameters, and then put it into the managed-ledger cursor through the zk client server such as curator,
However, since the managed-ledger here may touch multiple copies of the bk node metadata when reading and writing zk,
Now there are options such as rocksdb, so it needs to be unified and compatible in the underlying logic of AdminCli.

Pulsar's internal protocol serialization data (xxxxmessage.proto) in the znode needs to download metadata without breaking the existing internal internal protocol. How should I do? Because in my opinion need to do a layer of decompression abstraction

Alternatives

none

Anything else?

none

Are you willing to submit a PR?

  • I'm willing to submit a PR!
@kaori-seasons kaori-seasons added the type/enhancement The enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages label Jan 28, 2023
@kaori-seasons kaori-seasons closed this as not planned Won't fix, can't repro, duplicate, stale Jan 28, 2023
@kaori-seasons kaori-seasons reopened this Jan 29, 2023
@github-actions
Copy link

github-actions bot commented Mar 1, 2023

The issue had no activity for 30 days, mark with Stale label.

@github-actions github-actions bot added the Stale label Mar 1, 2023
@apache apache locked and limited conversation to collaborators Mar 1, 2023
@tisonkun tisonkun converted this issue into discussion #19668 Mar 1, 2023

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

Labels
Stale type/enhancement The enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages
Projects
None yet
Development

No branches or pull requests

1 participant