Skip to content

Navigation Menu

Sign in
Sign up

--shuffle, --shuffle-seed - #443

Open
maurycy wants to merge 2 commits into
python:main from
maurycy:shuffle
Open

--shuffle, --shuffle-seed #443
maurycy wants to merge 2 commits into
python:main from
maurycy:shuffle

Conversation

@maurycy

@maurycy maurycy commented Dec 5, 2025
edited
Loading

Copy link
Copy Markdown
Contributor

The current order is sorted:

to_run = sorted(should_run)

The rationale: with the increasing number of runtime optimizations (eg: JIT, branch predictors etc.) there might be a small penalty (or reward) based on order of execution.

Copy link
Copy Markdown
Member

I don't think we should be shuffling benchmarks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

AltStyle によって変換されたページ (->オリジナル) /