Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chore(tests): move sionna download to fixture #114

Merged
merged 4 commits into from
Sep 16, 2024
Merged

chore(tests): move sionna download to fixture #114

merged 4 commits into from
Sep 16, 2024

Conversation

jeertmans
Copy link
Owner

No description provided.

@github-actions github-actions bot added documentation Improvements or additions to documentation python Changes Python code rust Changes Rust code tests Changes tests labels Sep 16, 2024
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Sep 16, 2024 •
edited
Loading

Python benchmark results:


------------------------------- benchmark 'test_complete_graph_all_paths': 3 tests ------------------------------
Name (time in ns)                                    Mean                StdDev            OPS (Mops/s)          
-----------------------------------------------------------------------------------------------------------------
test_complete_graph_all_paths (0010_before)      718.0580 (1.12)       716.2323 (1.0)            1.3926 (0.89)   
test_complete_graph_all_paths (0002_changes)     712.8726 (1.11)     1,484.9243 (2.07)           1.4028 (0.90)   
test_complete_graph_all_paths (0006_pgo)         641.1615 (1.0)      1,960.1529 (2.74)           1.5597 (1.0)    
-----------------------------------------------------------------------------------------------------------------

----------------------------- benchmark 'test_complete_graph_all_paths_array_chunks[1000]': 3 tests -----------------------------
Name (time in ns)                                                      Mean              StdDev            OPS (Mops/s)          
---------------------------------------------------------------------------------------------------------------------------------
test_complete_graph_all_paths_array_chunks[1000] (0005_pgo)         52.4695 (1.0)      136.1654 (16.56)         19.0587 (1.0)    
test_complete_graph_all_paths_array_chunks[1000] (0009_before)      56.2457 (1.07)     143.6166 (17.47)         17.7791 (0.93)   
test_complete_graph_all_paths_array_chunks[1000] (0001_changes)     58.0587 (1.11)       8.2226 (1.0)           17.2239 (0.90)   
---------------------------------------------------------------------------------------------------------------------------------

----------------------------- benchmark 'test_complete_graph_all_paths_array_chunks[100]': 3 tests -----------------------------
Name (time in ns)                                                     Mean              StdDev            OPS (Mops/s)          
--------------------------------------------------------------------------------------------------------------------------------
test_complete_graph_all_paths_array_chunks[100] (0003_changes)     77.0779 (1.07)     441.0426 (1.21)          12.9739 (0.93)   
test_complete_graph_all_paths_array_chunks[100] (0012_before)      75.9403 (1.06)     365.2311 (1.0)           13.1682 (0.95)   
test_complete_graph_all_paths_array_chunks[100] (0007_pgo)         71.7681 (1.0)      488.3914 (1.34)          13.9338 (1.0)    
--------------------------------------------------------------------------------------------------------------------------------

----------------------------- benchmark 'test_complete_graph_all_paths_array_chunks[10]': 3 tests ------------------------------
Name (time in ns)                                                     Mean              StdDev            OPS (Mops/s)          
--------------------------------------------------------------------------------------------------------------------------------
test_complete_graph_all_paths_array_chunks[10] (0007_pgo)         133.4596 (1.0)       54.1706 (2.08)           7.4929 (1.0)    
test_complete_graph_all_paths_array_chunks[10] (0003_changes)     160.2579 (1.20)      26.0284 (1.0)            6.2399 (0.83)   
test_complete_graph_all_paths_array_chunks[10] (0012_before)      161.8203 (1.21)     305.6951 (11.74)          6.1797 (0.82)   
--------------------------------------------------------------------------------------------------------------------------------

------------------------------- benchmark 'test_complete_graph_all_paths_array_chunks[1]': 3 tests ------------------------------
Name (time in ns)                                                    Mean                StdDev            OPS (Mops/s)          
---------------------------------------------------------------------------------------------------------------------------------
test_complete_graph_all_paths_array_chunks[1] (0006_pgo)         525.2129 (1.0)      2,392.6870 (1.58)           1.9040 (1.0)    
test_complete_graph_all_paths_array_chunks[1] (0010_before)      690.2828 (1.31)     2,910.0628 (1.92)           1.4487 (0.76)   
test_complete_graph_all_paths_array_chunks[1] (0002_changes)     623.5162 (1.19)     1,514.6637 (1.0)            1.6038 (0.84)   
---------------------------------------------------------------------------------------------------------------------------------

-------------------------------- benchmark 'test_di_graph_from_complete_graph_all_paths': 3 tests -------------------------------
Name (time in ns)                                                    Mean                StdDev            OPS (Kops/s)          
---------------------------------------------------------------------------------------------------------------------------------
test_di_graph_from_complete_graph_all_paths (0005_pgo)         1,189.1832 (1.0)      8,476.3114 (1.31)         840.9133 (1.0)    
test_di_graph_from_complete_graph_all_paths (0001_changes)     1,295.4723 (1.09)     6,457.9290 (1.0)          771.9192 (0.92)   
test_di_graph_from_complete_graph_all_paths (0009_before)      1,243.8536 (1.05)     6,487.3844 (1.00)         803.9532 (0.96)   
---------------------------------------------------------------------------------------------------------------------------------

----------------------------- benchmark 'test_di_graph_from_complete_graph_all_paths_array_chunks[1000]': 3 tests -----------------------------
Name (time in ns)                                                                     Mean             StdDev            OPS (Mops/s)          
-----------------------------------------------------------------------------------------------------------------------------------------------
test_di_graph_from_complete_graph_all_paths_array_chunks[1000] (0003_changes)     247.8486 (1.01)     37.7018 (1.16)           4.0347 (0.99)   
test_di_graph_from_complete_graph_all_paths_array_chunks[1000] (0008_pgo)         245.7672 (1.0)      32.4017 (1.0)            4.0689 (1.0)    
test_di_graph_from_complete_graph_all_paths_array_chunks[1000] (0011_before)      299.3542 (1.22)     49.6708 (1.53)           3.3405 (0.82)   
-----------------------------------------------------------------------------------------------------------------------------------------------

----------------------------- benchmark 'test_di_graph_from_complete_graph_all_paths_array_chunks[100]': 3 tests -----------------------------
Name (time in ns)                                                                    Mean             StdDev            OPS (Mops/s)          
----------------------------------------------------------------------------------------------------------------------------------------------
test_di_graph_from_complete_graph_all_paths_array_chunks[100] (0007_pgo)         260.2369 (1.0)      26.7042 (1.0)            3.8427 (1.0)    
test_di_graph_from_complete_graph_all_paths_array_chunks[100] (0012_before)      279.0688 (1.07)     41.0906 (1.54)           3.5833 (0.93)   
test_di_graph_from_complete_graph_all_paths_array_chunks[100] (0004_changes)     277.5947 (1.07)     52.1076 (1.95)           3.6024 (0.94)   
----------------------------------------------------------------------------------------------------------------------------------------------

------------------------------ benchmark 'test_di_graph_from_complete_graph_all_paths_array_chunks[10]': 3 tests -------------------------------
Name (time in ns)                                                                   Mean                StdDev            OPS (Mops/s)          
------------------------------------------------------------------------------------------------------------------------------------------------
test_di_graph_from_complete_graph_all_paths_array_chunks[10] (0008_pgo)         513.7078 (1.0)      2,625.2749 (1.52)           1.9466 (1.0)    
test_di_graph_from_complete_graph_all_paths_array_chunks[10] (0004_changes)     538.1707 (1.05)     1,723.1834 (1.0)            1.8581 (0.95)   
test_di_graph_from_complete_graph_all_paths_array_chunks[10] (0011_before)      536.4127 (1.04)     2,757.4172 (1.60)           1.8642 (0.96)   
------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------- benchmark 'test_di_graph_from_complete_graph_all_paths_array_chunks[1]': 3 tests -------------------------------
Name (time in ns)                                                                    Mean                StdDev            OPS (Kops/s)          
-------------------------------------------------------------------------------------------------------------------------------------------------
test_di_graph_from_complete_graph_all_paths_array_chunks[1] (0008_pgo)         1,117.1864 (1.02)     6,464.0203 (24.47)        895.1058 (0.99)   
test_di_graph_from_complete_graph_all_paths_array_chunks[1] (0004_changes)     1,100.5659 (1.0)        264.1497 (1.0)          908.6235 (1.0)    
test_di_graph_from_complete_graph_all_paths_array_chunks[1] (0011_before)      1,138.6836 (1.03)     3,185.0491 (12.06)        878.2071 (0.97)   
-------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Sep 16, 2024 •
edited
Loading

Rust benchmark results:

group                                                       before                                 changes
-----                                                       ------                                 -------
complete_graph_all_paths/iter                               1.00     24.0±0.28ns 39.7 MElem/sec    1.00     24.1±0.30ns 39.7 MElem/sec
complete_graph_all_paths_array_chunks/1                     1.00     32.5±0.20ns 29.4 MElem/sec    1.01     32.9±0.21ns 29.0 MElem/sec
complete_graph_all_paths_array_chunks/10                    1.02    344.9±2.61ns 27.6 MElem/sec    1.00    336.6±7.42ns 28.3 MElem/sec
complete_graph_all_paths_array_chunks/100                   1.03      2.5±0.03µs 38.2 MElem/sec    1.00      2.4±0.02µs 39.3 MElem/sec
complete_graph_all_paths_array_chunks/1000                  1.00     22.3±0.35µs 42.8 MElem/sec    1.01     22.5±0.68µs 42.5 MElem/sec
di_graph_from_complete_graph_all_paths/iter                 1.02    229.2±2.42ns  4.2 MElem/sec    1.00    225.8±4.08ns  4.2 MElem/sec
di_graph_from_complete_graph_all_paths_array_chunks/1       1.00    235.9±4.62ns  4.0 MElem/sec    1.00    236.8±2.83ns  4.0 MElem/sec
di_graph_from_complete_graph_all_paths_array_chunks/10      1.00      2.7±0.03µs  3.5 MElem/sec    1.07      2.9±0.05µs  3.3 MElem/sec
di_graph_from_complete_graph_all_paths_array_chunks/100     1.00     23.4±0.76µs  4.1 MElem/sec    1.15     26.8±0.26µs  3.6 MElem/sec
di_graph_from_complete_graph_all_paths_array_chunks/1000    1.00    232.9±3.75µs  4.1 MElem/sec    1.10    256.7±5.78µs  3.7 MElem/sec

@codecov Codecov
Copy link

codecov bot commented Sep 16, 2024 •
edited
Loading

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 98.93%. Comparing base (abd17bc) to head (f49b0a0).
Report is 120 commits behind head on main.

Additional details and impacted files 
@@           Coverage Diff           @@
##             main     #114   +/-   ##
=======================================
  Coverage   98.93%   98.93%           
=======================================
  Files          20       20           
  Lines         845      845           
=======================================
  Hits          836      836           
  Misses          9        9

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@jeertmans jeertmans merged commit f14b08d into main Sep 16, 2024
6 of 7 checks passed
@jeertmans jeertmans deleted the tests branch September 16, 2024 14:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
dependencies documentation Improvements or additions to documentation python Changes Python code rust Changes Rust code tests Changes tests
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@jeertmans