Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update the version of TIMES-NZ used in benchmarks #312

Merged
merged 2 commits into from
Feb 4, 2025

Conversation

olejandro
Copy link
Member

No description provided.

Copy link

github-actions bot commented Feb 4, 2025

Regression test results on commit 4586492

         Benchmark    Time (s)                 GDX Diff     Accuracy       Correct    Additional
------------------  ----------  -----------------------  -----------  ------------  ------------
     DemoS_001-all   2.0   2.8            OK         OK  100.0 100.0    118    118      3      3
     DemoS_002-all   2.3   2.5            OK         OK  100.0 100.0    344    344      3      3
     DemoS_003-all   2.6   3.0            OK         OK  100.0 100.0    633    633      6      6
         DemoS_004   2.7   3.2            OK         OK  100.0 100.0    662    662     12     12
        DemoS_004a   2.8   3.5            OK         OK  100.0 100.0    665    665     12     12
DemoS_004a-ie-test   3.0   3.4            OK         OK  100.0 100.0    667    667     12     12
        DemoS_004b   2.8   3.4            OK         OK  100.0 100.0    665    665     12     12
     DemoS_004-all   2.9   3.4            OK         OK  100.0 100.0    667    667     12     12
     DemoS_005-all   3.3   4.1            13         13   99.7  99.7   1160   1160     12     12
     DemoS_006-all   4.1   5.1            13         13   99.7  99.7   1258   1258     12     12
     DemoS_007-all   5.0   5.9            13         13   99.8  99.8   2155   2155     12     12
  DemoS_007-all-1r   3.9   4.3            11         11   99.8  99.8   1179   1179     12     12
     DemoS_008-all   6.8   7.0            13         13   99.9  99.9   5333   5333     18     18
     DemoS_009-all   7.5   7.9            30         32   99.9  99.9   5807   5807     29     29
     DemoS_010-all   7.5   7.8           822        824   88.4  88.4   6139   6139     29     29
     DemoS_011-all   7.6   7.6           856        854   88.0  88.0   6150   6150     29     29
     DemoS_012-all   7.9   8.0           901        901   88.2  88.2   6306   6306     53     53
  DemoS_special-t1   4.0   3.8  Error runn… Error runn…   92.2  92.2   2108   2108     42     42
      TIMES-IE-all  23.0  23.1          3125       3125   97.5  97.5  42461  42461   2826   2826
      TIMES-IE-NoM  20.8  21.0           357        357   99.3  99.3  40529  40529    632    632
      TIMES-IE-MCB  20.5  20.8          1100       1100   97.6  97.6  42068  42068    632    632
      TIMES-NZ-KEA  24.5  23.9          3881       3881   98.5  98.5  76486  76486    342    342
      TIMES-NZ-TUI  17.1  17.0          3911       3911   98.5  98.5  76112  76112    358    358

2025-02-04 05:34:15.799 |     INFO : Total runtime: 192.49s (main: 184.65s)
2025-02-04 05:34:15.800 |     INFO : Change in runtime (negative == faster): +7.84s (+4.2%)
2025-02-04 05:34:15.800 |     INFO : Change in correct rows (higher == better): +0 (+0.0%)
2025-02-04 05:34:15.800 |     INFO : Change in additional rows: +0 (+0.0%)
2025-02-04 05:34:15.800 |  SUCCESS : No regressions. You're awesome!

This comment will be updated when new commits are added to the PR.

@siddharth-krishna siddharth-krishna enabled auto-merge (squash) February 4, 2025 05:29
@siddharth-krishna siddharth-krishna merged commit 0b4b369 into main Feb 4, 2025
2 checks passed
@siddharth-krishna siddharth-krishna deleted the olex/update-benchmark branch February 4, 2025 05:34
siddharth-krishna added a commit that referenced this pull request Feb 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants