fork: python
ref: c15f94d6fbc960790db3
machine: linux-x86_64
commit hash: c15f94d
commit date: 2024-06-08
overall geometric mean: 1.11x slower
HPT reliability: 99.99%
HPT 99th percentile: 1.03x slower
Memory change: 1.27x
Benchmarks with tag 'apps':
Benchmark
bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120
bm-20240608-linux-x86_64-python-c15f94d6fbc960790db3-3.13.0b2+-c15f94d
2to3
348 ms
393 ms: 1.13x slower
chameleon
9.68 ms
12.0 ms: 1.24x slower
docutils
3.30 sec
3.40 sec: 1.03x slower
html5lib
88.9 ms
99.0 ms: 1.11x slower
tornado_http
136 ms
134 ms: 1.01x faster
Geometric mean
(ref)
1.10x slower
Benchmarks with tag 'asyncio':
Benchmark
bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120
bm-20240608-linux-x86_64-python-c15f94d6fbc960790db3-3.13.0b2+-c15f94d
async_tree_io
1.77 sec
922 ms: 1.92x faster
async_tree_none
728 ms
447 ms: 1.63x faster
async_tree_memoization
870 ms
554 ms: 1.57x faster
async_tree_cpu_io_mixed
1.02 sec
712 ms: 1.43x faster
Geometric mean
(ref)
1.63x faster
Benchmarks with tag 'math':
Benchmark
bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120
bm-20240608-linux-x86_64-python-c15f94d6fbc960790db3-3.13.0b2+-c15f94d
pidigits
191 ms
186 ms: 1.02x faster
float
117 ms
131 ms: 1.12x slower
nbody
154 ms
216 ms: 1.41x slower
Geometric mean
(ref)
1.15x slower
Benchmarks with tag 'regex':
Benchmark
bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120
bm-20240608-linux-x86_64-python-c15f94d6fbc960790db3-3.13.0b2+-c15f94d
regex_v8
27.8 ms
26.9 ms: 1.03x faster
regex_dna
227 ms
229 ms: 1.01x slower
regex_compile
188 ms
213 ms: 1.13x slower
Geometric mean
(ref)
1.02x slower
Benchmark hidden because not significant (1): regex_effbot
Benchmarks with tag 'serialize':
Benchmark
bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120
bm-20240608-linux-x86_64-python-c15f94d6fbc960790db3-3.13.0b2+-c15f94d
xml_etree_parse
168 ms
145 ms: 1.16x faster
pickle_list
5.08 us
4.87 us: 1.04x faster
xml_etree_iterparse
115 ms
111 ms: 1.04x faster
json_dumps
14.2 ms
13.8 ms: 1.03x faster
json_loads
31.2 us
31.7 us: 1.02x slower
tomli_loads
3.14 sec
3.19 sec: 1.02x slower
unpickle_list
5.20 us
5.52 us: 1.06x slower
xml_etree_generate
99.4 ms
109 ms: 1.10x slower
xml_etree_process
79.1 ms
88.7 ms: 1.12x slower
pickle
10.7 us
12.1 us: 1.14x slower
unpickle
14.4 us
16.5 us: 1.15x slower
unpickle_pure_python
331 us
388 us: 1.18x slower
pickle_pure_python
484 us
571 us: 1.18x slower
pickle_dict
29.6 us
43.8 us: 1.48x slower
Geometric mean
(ref)
1.08x slower
Benchmarks with tag 'startup':
Benchmark
bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120
bm-20240608-linux-x86_64-python-c15f94d6fbc960790db3-3.13.0b2+-c15f94d
python_startup
14.6 ms
13.9 ms: 1.05x faster
python_startup_no_site
5.93 ms
9.19 ms: 1.55x slower
Geometric mean
(ref)
1.21x slower
Benchmarks with tag 'template':
Benchmark
bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120
bm-20240608-linux-x86_64-python-c15f94d6fbc960790db3-3.13.0b2+-c15f94d
django_template
48.2 ms
58.2 ms: 1.21x slower
genshi_text
31.8 ms
38.5 ms: 1.21x slower
genshi_xml
66.0 ms
80.4 ms: 1.22x slower
mako
16.3 ms
20.1 ms: 1.23x slower
Geometric mean
(ref)
1.22x slower
Benchmark
bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120
bm-20240608-linux-x86_64-python-c15f94d6fbc960790db3-3.13.0b2+-c15f94d
typing_runtime_protocols
544 us
251 us: 2.17x faster
generators
80.1 ms
39.0 ms: 2.06x faster
async_tree_io
1.77 sec
922 ms: 1.92x faster
async_tree_none
728 ms
447 ms: 1.63x faster
async_tree_memoization
870 ms
554 ms: 1.57x faster
asyncio_tcp
922 ms
591 ms: 1.56x faster
async_tree_cpu_io_mixed
1.02 sec
712 ms: 1.43x faster
pylint
551 ms
393 ms: 1.40x faster
gc_traversal
3.62 ms
2.67 ms: 1.36x faster
asyncio_tcp_ssl
2.57 sec
2.03 sec: 1.27x faster
crypto_pyaes
128 ms
108 ms: 1.19x faster
create_gc_cycles
1.62 ms
1.39 ms: 1.17x faster
xml_etree_parse
168 ms
145 ms: 1.16x faster
bench_mp_pool
24.0 ms
20.7 ms: 1.16x faster
coroutines
35.1 ms
30.7 ms: 1.14x faster
python_startup
14.6 ms
13.9 ms: 1.05x faster
pickle_list
5.08 us
4.87 us: 1.04x faster
comprehensions
28.8 us
27.7 us: 1.04x faster
xml_etree_iterparse
115 ms
111 ms: 1.04x faster
regex_v8
27.8 ms
26.9 ms: 1.03x faster
json_dumps
14.2 ms
13.8 ms: 1.03x faster
pidigits
191 ms
186 ms: 1.02x faster
tornado_http
136 ms
134 ms: 1.01x faster
scimark_fft
466 ms
460 ms: 1.01x faster
pathlib
20.5 ms
20.5 ms: 1.00x slower
logging_silent
190 ns
192 ns: 1.01x slower
regex_dna
227 ms
229 ms: 1.01x slower
asyncio_websockets
559 ms
567 ms: 1.01x slower
json_loads
31.2 us
31.7 us: 1.02x slower
tomli_loads
3.14 sec
3.19 sec: 1.02x slower
pycparser
1.58 sec
1.61 sec: 1.02x slower
dulwich_log
84.3 ms
86.2 ms: 1.02x slower
docutils
3.30 sec
3.40 sec: 1.03x slower
scimark_monte_carlo
118 ms
123 ms: 1.04x slower
spectral_norm
170 ms
177 ms: 1.04x slower
chaos
115 ms
120 ms: 1.04x slower
pyflate
716 ms
748 ms: 1.04x slower
json
5.69 ms
5.94 ms: 1.04x slower
richards_super
94.7 ms
99.1 ms: 1.05x slower
deltablue
7.91 ms
8.28 ms: 1.05x slower
sqlite_synth
3.02 us
3.17 us: 1.05x slower
fannkuch
532 ms
561 ms: 1.06x slower
richards
79.3 ms
84.2 ms: 1.06x slower
unpickle_list
5.20 us
5.52 us: 1.06x slower
nqueens
106 ms
113 ms: 1.07x slower
deepcopy_memo
58.5 us
63.7 us: 1.09x slower
xml_etree_generate
99.4 ms
109 ms: 1.10x slower
sympy_integrate
25.8 ms
28.3 ms: 1.10x slower
aiohttp
1.44 ms
1.58 ms: 1.10x slower
html5lib
88.9 ms
99.0 ms: 1.11x slower
float
117 ms
131 ms: 1.12x slower
gunicorn
1.53 ms
1.72 ms: 1.12x slower
xml_etree_process
79.1 ms
88.7 ms: 1.12x slower
2to3
348 ms
393 ms: 1.13x slower
hexiom
10.4 ms
11.7 ms: 1.13x slower
regex_compile
188 ms
213 ms: 1.13x slower
pickle
10.7 us
12.1 us: 1.14x slower
unpickle
14.4 us
16.5 us: 1.15x slower
raytrace
507 ms
586 ms: 1.16x slower
sqlglot_transpile
2.57 ms
2.99 ms: 1.16x slower
deepcopy
479 us
559 us: 1.17x slower
scimark_sor
220 ms
257 ms: 1.17x slower
unpickle_pure_python
331 us
388 us: 1.18x slower
pickle_pure_python
484 us
571 us: 1.18x slower
mdp
2.85 sec
3.37 sec: 1.18x slower
sqlglot_parse
2.17 ms
2.57 ms: 1.18x slower
sqlglot_normalize
143 ms
171 ms: 1.20x slower
mypy2
894 ms
1.07 sec: 1.20x slower
meteor_contest
120 ms
144 ms: 1.21x slower
django_template
48.2 ms
58.2 ms: 1.21x slower
sympy_str
346 ms
418 ms: 1.21x slower
genshi_text
31.8 ms
38.5 ms: 1.21x slower
genshi_xml
66.0 ms
80.4 ms: 1.22x slower
deepcopy_reduce
4.17 us
5.11 us: 1.23x slower
mako
16.3 ms
20.1 ms: 1.23x slower
async_generators
444 ms
550 ms: 1.24x slower
logging_simple
8.30 us
10.3 us: 1.24x slower
sqlglot_optimize
69.2 ms
85.9 ms: 1.24x slower
pprint_safe_repr
1.02 sec
1.26 sec: 1.24x slower
chameleon
9.68 ms
12.0 ms: 1.24x slower
pprint_pformat
2.10 sec
2.63 sec: 1.25x slower
go
240 ms
304 ms: 1.27x slower
sympy_sum
196 ms
252 ms: 1.28x slower
logging_format
9.09 us
11.7 us: 1.28x slower
sympy_expand
566 ms
743 ms: 1.31x slower
scimark_lu
176 ms
232 ms: 1.31x slower
telco
7.27 ms
9.68 ms: 1.33x slower
nbody
154 ms
216 ms: 1.41x slower
pickle_dict
29.6 us
43.8 us: 1.48x slower
python_startup_no_site
5.93 ms
9.19 ms: 1.55x slower
flaskblogging
8.58 ms
13.4 ms: 1.57x slower
bench_thread_pool
986 us
3.05 ms: 3.09x slower
coverage
79.4 ms
760 ms: 9.57x slower
thrift
1.07 ms
12.8 ms: 11.91x slower
Geometric mean
(ref)
1.11x slower
Benchmark hidden because not significant (2): regex_effbot, scimark_sparse_mat_mult
Ignored benchmarks (5) of results/bm-20220323-3.10.4-9d38120/bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120.json: dask, djangocms, sqlalchemy_declarative, sqlalchemy_imperative, unpack_sequence
Ignored benchmarks (5) of results/bm-20240608-3.13.0b2+-c15f94d-NOGIL/bm-20240608-linux-x86_64-python-c15f94d6fbc960790db3-3.13.0b2+-c15f94d.json: async_tree_cpu_io_mixed_tg, async_tree_io_tg, async_tree_memoization_tg, async_tree_none_tg, bpe_tokeniser
Reliability score: 99.99% likely to be slow
90% likely to have a slowdown of 1.04x
95% likely to have a slowdown of 1.03x
99% likely to have a slowdown of 1.03x