Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CoalesceBatches doesn't provide correct elapsed_compute info in metrics #3894

Closed
Dandandan opened this issue Oct 19, 2022 · 0 comments · Fixed by #4664
Closed

CoalesceBatches doesn't provide correct elapsed_compute info in metrics #3894

Dandandan opened this issue Oct 19, 2022 · 0 comments · Fixed by #4664
Labels
bug Something isn't working

Comments

@Dandandan
Copy link
Contributor

Describe the bug
elapsed_compute for CoalesceBatches consists of all the time it took to wait for the batch + process it instead only the computation time

To Reproduce
Look at metrics, see metric suggests to consume a lot more than other nodes (where it doesn´t).

Expected behavior
Should measure the computation time.

Additional context
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix CoalesceBatches elasped_compute metric Jefffrey/arrow-datafusion
1 participant
@Dandandan