Skip to content

Latest commit

 

History

History
199 lines (175 loc) · 38.5 KB

bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26-vs-base.md

File metadata and controls

199 lines (175 loc) · 38.5 KB

Results vs. base

  • fork: python
  • ref: a19bb261a327e1008f21
  • machine: linux-aarch64
  • commit hash: a19bb26
  • commit date: 2024-06-15
  • overall geometric mean: 1.11x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.08x slower
  • Memory change: 1.02x

Benchmarks with tag 'apps':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
2to3 308 ms 346 ms: 1.13x slower
chameleon 8.96 ms 10.1 ms: 1.12x slower
docutils 3.09 sec 3.51 sec: 1.14x slower
html5lib 66.3 ms 72.5 ms: 1.09x slower
tornado_http 130 ms 136 ms: 1.05x slower
Geometric mean (ref) 1.10x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
async_tree_io_tg 1.27 sec 1.24 sec: 1.02x faster
async_tree_cpu_io_mixed_tg 764 ms 794 ms: 1.04x slower
async_tree_none_tg 470 ms 489 ms: 1.04x slower
async_tree_memoization_tg 601 ms 629 ms: 1.05x slower
async_tree_io 1.20 sec 1.26 sec: 1.05x slower
async_tree_memoization 639 ms 674 ms: 1.05x slower
async_tree_cpu_io_mixed 784 ms 826 ms: 1.05x slower
async_tree_none 487 ms 521 ms: 1.07x slower
Geometric mean (ref) 1.04x slower

Benchmarks with tag 'math':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
nbody 113 ms 131 ms: 1.16x slower
float 92.2 ms 108 ms: 1.17x slower
Geometric mean (ref) 1.11x slower

Benchmark hidden because not significant (1): pidigits

Benchmarks with tag 'regex':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
regex_v8 30.4 ms 31.3 ms: 1.03x slower
regex_compile 130 ms 159 ms: 1.23x slower
Geometric mean (ref) 1.06x slower

Benchmark hidden because not significant (2): regex_dna, regex_effbot

Benchmarks with tag 'serialize':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
unpickle_list 6.67 us 6.38 us: 1.05x faster
json_loads 33.0 us 32.1 us: 1.03x faster
pickle_dict 38.0 us 37.6 us: 1.01x faster
xml_etree_process 82.6 ms 85.9 ms: 1.04x slower
xml_etree_generate 116 ms 122 ms: 1.05x slower
xml_etree_iterparse 147 ms 155 ms: 1.05x slower
tomli_loads 2.56 sec 2.97 sec: 1.16x slower
pickle_pure_python 355 us 428 us: 1.21x slower
unpickle_pure_python 254 us 329 us: 1.29x slower
Geometric mean (ref) 1.05x slower

Benchmark hidden because not significant (5): json_dumps, pickle_list, unpickle, xml_etree_parse, pickle

Benchmarks with tag 'startup':

Benchmark hidden because not significant (2): python_startup, python_startup_no_site

Benchmarks with tag 'template':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
mako 13.6 ms 15.6 ms: 1.14x slower
django_template 41.4 ms 48.5 ms: 1.17x slower
genshi_xml 61.3 ms 75.6 ms: 1.23x slower
genshi_text 27.9 ms 35.7 ms: 1.28x slower
Geometric mean (ref) 1.21x slower

All benchmarks:

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
unpickle_list 6.67 us 6.38 us: 1.05x faster
json_loads 33.0 us 32.1 us: 1.03x faster
async_tree_io_tg 1.27 sec 1.24 sec: 1.02x faster
pickle_dict 38.0 us 37.6 us: 1.01x faster
json 5.82 ms 5.88 ms: 1.01x slower
logging_format 7.82 us 7.94 us: 1.02x slower
sqlite_synth 3.91 us 4.00 us: 1.02x slower
coverage 99.2 ms 102 ms: 1.02x slower
thrift 946 us 973 us: 1.03x slower
regex_v8 30.4 ms 31.3 ms: 1.03x slower
pathlib 22.7 ms 23.5 ms: 1.03x slower
async_tree_cpu_io_mixed_tg 764 ms 794 ms: 1.04x slower
async_tree_none_tg 470 ms 489 ms: 1.04x slower
xml_etree_process 82.6 ms 85.9 ms: 1.04x slower
coroutines 29.0 ms 30.3 ms: 1.04x slower
flaskblogging 4.80 ms 5.01 ms: 1.04x slower
dask 371 ms 387 ms: 1.04x slower
tornado_http 130 ms 136 ms: 1.05x slower
async_tree_memoization_tg 601 ms 629 ms: 1.05x slower
asyncio_tcp 574 ms 602 ms: 1.05x slower
async_tree_io 1.20 sec 1.26 sec: 1.05x slower
xml_etree_generate 116 ms 122 ms: 1.05x slower
async_tree_memoization 639 ms 674 ms: 1.05x slower
xml_etree_iterparse 147 ms 155 ms: 1.05x slower
async_tree_cpu_io_mixed 784 ms 826 ms: 1.05x slower
async_generators 490 ms 521 ms: 1.06x slower
aiohttp 1.19 ms 1.27 ms: 1.06x slower
generators 37.3 ms 39.9 ms: 1.07x slower
async_tree_none 487 ms 521 ms: 1.07x slower
mdp 3.33 sec 3.57 sec: 1.07x slower
bench_thread_pool 1.26 ms 1.36 ms: 1.07x slower
telco 9.96 ms 10.8 ms: 1.09x slower
html5lib 66.3 ms 72.5 ms: 1.09x slower
dulwich_log 59.2 ms 65.0 ms: 1.10x slower
pycparser 1.22 sec 1.34 sec: 1.10x slower
richards_super 63.4 ms 70.4 ms: 1.11x slower
richards 56.5 ms 63.3 ms: 1.12x slower
deepcopy_reduce 4.10 us 4.61 us: 1.12x slower
chameleon 8.96 ms 10.1 ms: 1.12x slower
2to3 308 ms 346 ms: 1.13x slower
mypy2 763 ms 860 ms: 1.13x slower
raytrace 297 ms 335 ms: 1.13x slower
typing_runtime_protocols 199 us 225 us: 1.13x slower
pylint 341 ms 387 ms: 1.13x slower
docutils 3.09 sec 3.51 sec: 1.14x slower
sqlglot_normalize 129 ms 147 ms: 1.14x slower
sympy_expand 454 ms 516 ms: 1.14x slower
sqlglot_optimize 62.6 ms 71.3 ms: 1.14x slower
mako 13.6 ms 15.6 ms: 1.14x slower
meteor_contest 114 ms 130 ms: 1.15x slower
bpe_tokeniser 5.76 sec 6.61 sec: 1.15x slower
sympy_sum 145 ms 167 ms: 1.16x slower
nbody 113 ms 131 ms: 1.16x slower
scimark_fft 444 ms 516 ms: 1.16x slower
tomli_loads 2.56 sec 2.97 sec: 1.16x slower
sympy_str 265 ms 309 ms: 1.16x slower
fannkuch 450 ms 525 ms: 1.17x slower
django_template 41.4 ms 48.5 ms: 1.17x slower
float 92.2 ms 108 ms: 1.17x slower
deepcopy 448 us 525 us: 1.17x slower
scimark_sparse_mat_mult 6.53 ms 7.70 ms: 1.18x slower
sqlglot_parse 1.40 ms 1.66 ms: 1.19x slower
crypto_pyaes 81.5 ms 96.8 ms: 1.19x slower
go 161 ms 192 ms: 1.19x slower
sympy_integrate 20.8 ms 25.1 ms: 1.21x slower
pickle_pure_python 355 us 428 us: 1.21x slower
pyflate 559 ms 674 ms: 1.21x slower
chaos 67.8 ms 81.8 ms: 1.21x slower
pprint_safe_repr 936 ms 1.13 sec: 1.21x slower
pprint_pformat 1.91 sec 2.32 sec: 1.21x slower
bench_mp_pool 6.97 ms 8.48 ms: 1.22x slower
sqlglot_transpile 1.72 ms 2.10 ms: 1.22x slower
spectral_norm 140 ms 172 ms: 1.23x slower
regex_compile 130 ms 159 ms: 1.23x slower
scimark_sor 160 ms 197 ms: 1.23x slower
genshi_xml 61.3 ms 75.6 ms: 1.23x slower
nqueens 99.2 ms 125 ms: 1.26x slower
genshi_text 27.9 ms 35.7 ms: 1.28x slower
scimark_monte_carlo 82.6 ms 107 ms: 1.29x slower
unpickle_pure_python 254 us 329 us: 1.29x slower
deltablue 3.88 ms 5.09 ms: 1.31x slower
logging_silent 133 ns 175 ns: 1.32x slower
deepcopy_memo 50.5 us 67.5 us: 1.34x slower
comprehensions 20.2 us 28.0 us: 1.38x slower
hexiom 7.14 ms 9.96 ms: 1.39x slower
scimark_lu 143 ms 205 ms: 1.43x slower
Geometric mean (ref) 1.11x slower

Benchmark hidden because not significant (16): json_dumps, python_startup, gc_traversal, asyncio_websockets, regex_dna, pickle_list, unpickle, asyncio_tcp_ssl, xml_etree_parse, python_startup_no_site, pidigits, regex_effbot, pickle, create_gc_cycles, gunicorn, logging_simple

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.09x
  • 95% likely to have a slowdown of 1.09x
  • 99% likely to have a slowdown of 1.08x

Memory

  • memory change: 1.02x