Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add CI/benchmarks for Ruby 3.3 #335

Merged
merged 2 commits into from
Jun 10, 2024
Merged

Add CI/benchmarks for Ruby 3.3 #335

merged 2 commits into from
Jun 10, 2024

Conversation

JacobEvelyn
Copy link
Member

@JacobEvelyn JacobEvelyn commented Mar 20, 2024

This commit updates our CI to run tests and
benchmarks on Ruby 3.3. Note that it does not
yet run CI benchmarks using YJIT.

As a part of this change, the dokaz gem
is pinned to run on Ruby 3.2 instead of the
latest Ruby version because the gem does
not work in 3.3+. If that changes, we can
go back to running it on the latest supported
Ruby. See: zverok/dokaz#3

Before merging:

  • Copy the table printed at the end of the latest benchmark results into the README.md and update this PR
  • If this change merits an update to CHANGELOG.md, add an entry following Keep a Changelog guidelines with semantic versioning

Copy link

codecov bot commented Mar 20, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 100.00%. Comparing base (f11fa76) to head (219a2cc).

Additional details and impacted files
@@            Coverage Diff            @@
##              main      #335   +/-   ##
=========================================
  Coverage   100.00%   100.00%           
=========================================
  Files            2         2           
  Lines          190       190           
  Branches        90        90           
=========================================
  Hits           190       190           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@JacobEvelyn JacobEvelyn changed the title Try yjit benchmarks Add CI/benchmarks for Ruby 3.3 Jun 3, 2024
@JacobEvelyn JacobEvelyn force-pushed the ruby-3-3 branch 2 times, most recently from 21f5728 to 29d08dd Compare June 3, 2024 16:09
@JacobEvelyn JacobEvelyn force-pushed the ruby-3-3 branch 3 times, most recently from 1c0359b to b274e8e Compare June 10, 2024 17:41
@JacobEvelyn JacobEvelyn marked this pull request as ready for review June 10, 2024 17:41
|`(a, *args)`|0.78x|1.60x|
|`(a:, **kwargs)`|0.77x|2.12x|
|`(a, *args, b:, **kwargs)`|0.69x|1.40x|
|`()` (none)|0.60x|3.17x|
Copy link
Member Author

@JacobEvelyn JacobEvelyn Jun 10, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm pretty surprised by the performance degradation here—worse results basically across the board. I don't have time to investigate though. @ms-ati do you?

This commit updates our CI to run tests and
benchmarks on Ruby 3.3. Note that it does not
yet run CI benchmarks using YJIT.

As a part of this change, the `dokaz` gem
is pinned to run on Ruby 3.2 instead of the
latest Ruby version because the gem does
not work in 3.3+. If that changes, we can
go back to running it on the latest supported
Ruby. See: zverok/dokaz#3
Copy link
Contributor

@ms-ati ms-ati left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@JacobEvelyn JacobEvelyn merged commit 5659016 into main Jun 10, 2024
14 checks passed
@JacobEvelyn JacobEvelyn deleted the ruby-3-3 branch June 10, 2024 19:41
@JacobEvelyn JacobEvelyn mentioned this pull request Sep 17, 2024
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants