-
Notifications
You must be signed in to change notification settings - Fork 45
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
WIP: Benchmark flatten #234
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This PR deletes an existing BenchmarkGroup accidentally, other than that LGTM
############################################### | ||
# flatten iterator | ||
|
||
g = addgroup!(SUITE, "iterators", ["flatten"]) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This overwrites the other "iterators"
group defined above, which was likely not your intent.
Instead, it would probably make sense just to add these benchmarks to this existing "iterators"
group (e.g. just delete g = addgroup!(SUITE, "iterators", ["flatten"])
, add "flatten"
as a tag to the existing group, and remove the comment separator).
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Sorry about that.
Would it make sense for addgroup!
to error in this case?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hehe, I tend to think that would be a good idea ;-)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Would it make sense for addgroup! to error in this case?
Yeah, this would probably be more useful than the current behavior, which is for addgroup!(suite, id, args...)
to be a convenience function implementing g = BenchmarkGroup(args...); suite[id] = g; g
.
This reverts commit d77f701.
@mschauer I reverted this based on the comments by Jarrett. |
Thank you for the help, fixed and rebased at #237 |
* Show trials with 1 sample without error When only a single sample is present, show the info on that one result. Also use plurals appropriately with sample(s) and evaluation(s). * Add test for displaying single-sample trial
I think I do not understand the concept of
addgroup!
correctly, help welcome. In any case, these Benchmarks would be useful with JuliaLang/julia#29786 in mind.