Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

perf: set page size when keys and values are bounded #120

Merged
merged 38 commits into from
Sep 5, 2023

Conversation

ielashi
Copy link
Contributor

@ielashi ielashi commented Aug 30, 2023

Rather than using an arbitrary value for the page size in BTreeMap V2, we now use the same page size as V1 if both keys and values are bounded. We'll still add additional heuristics in the case where one of the keys/values is bounded, but that will happen in a followup.

Performance has improved by ~15%.

Benchmarking btreemap_insert_blob_4_1024: Warming up for 1.0000 ms
2023-08-30 14:48:09.204920 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "280_652_463 (28%)",
    "node_save_v1": "378_995_817 (38%)",
}

btreemap_insert_blob_4_1024
                        time:   [990.51 M Instructions 990.51 M Instructions 990.51 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_insert_blob_4_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:48:10.760660 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "333_201_038 (24%)",
    "node_save_v2": "672_434_881 (50%)",
}

btreemap_insert_blob_4_1024_v2
                        time:   [1333.5 M Instructions 1333.5 M Instructions 1333.5 M Instructions]
                        change: [-16.635% -16.635% -16.635%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_8_1024: Warming up for 1.0000 ms
2023-08-30 14:48:12.219407 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "321_869_274 (28%)",
    "node_save_v1": "403_319_104 (35%)",
}

btreemap_insert_blob_8_1024
                        time:   [1137.9 M Instructions 1137.9 M Instructions 1137.9 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_insert_blob_8_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:48:13.736975 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "378_171_967 (25%)",
    "node_save_v2": "723_402_856 (47%)",
}

btreemap_insert_blob_8_1024_v2
                        time:   [1510.7 M Instructions 1510.7 M Instructions 1510.7 M Instructions]
                        change: [-16.011% -16.011% -16.011%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_16_1024: Warming up for 1.0000 ms
2023-08-30 14:48:15.261612 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "402_518_468 (32%)",
    "node_save_v1": "412_342_578 (33%)",
}

btreemap_insert_blob_16_1024
                        time:   [1234.0 M Instructions 1234.0 M Instructions 1234.0 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_insert_blob_16_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:48:16.758872 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "478_257_902 (29%)",
    "node_save_v2": "751_822_661 (45%)",
}

btreemap_insert_blob_16_1024_v2
                        time:   [1645.2 M Instructions 1645.2 M Instructions 1645.2 M Instructions]
                        change: [-15.213% -15.213% -15.213%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_32_1024: Warming up for 1.0000 ms
2023-08-30 14:48:18.282766 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "424_603_999 (33%)",
    "node_save_v1": "424_971_825 (33%)",
}

btreemap_insert_blob_32_1024
                        time:   [1275.1 M Instructions 1275.1 M Instructions 1275.1 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_insert_blob_32_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:48:19.814212 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "509_874_962 (29%)",
    "node_save_v2": "781_178_979 (45%)",
}

btreemap_insert_blob_32_1024_v2
                        time:   [1707.0 M Instructions 1707.0 M Instructions 1707.0 M Instructions]
                        change: [-15.070% -15.070% -15.070%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_64_1024: Warming up for 1.0000 ms
2023-08-30 14:48:21.335028 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "629_811_234 (41%)",
    "node_save_v1": "427_811_631 (28%)",
}

btreemap_insert_blob_64_1024
                        time:   [1515.3 M Instructions 1515.3 M Instructions 1515.3 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_insert_blob_64_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:48:22.933073 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "726_492_646 (36%)",
    "node_save_v2": "797_852_825 (40%)",
}

btreemap_insert_blob_64_1024_v2
                        time:   [1983.3 M Instructions 1983.3 M Instructions 1983.3 M Instructions]
                        change: [-13.888% -13.888% -13.888%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_128_1024: Warming up for 1.0000 ms
2023-08-30 14:48:24.548313 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "854_194_111 (47%)",
    "node_save_v1": "433_801_175 (24%)",
}

btreemap_insert_blob_128_1024
                        time:   [1782.9 M Instructions 1782.9 M Instructions 1782.9 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_insert_blob_128_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:48:26.292367 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "951_814_553 (41%)",
    "node_save_v2": "826_627_910 (36%)",
}

btreemap_insert_blob_128_1024_v2
                        time:   [2286.1 M Instructions 2286.1 M Instructions 2286.1 M Instructions]
                        change: [-14.542% -14.542% -14.542%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_256_1024: Warming up for 1.0000 ms
2023-08-30 14:48:27.910282 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "1_308_925_598 (56%)",
    "node_save_v1": "439_514_594 (19%)",
}

btreemap_insert_blob_256_1024
                        time:   [2311.1 M Instructions 2311.1 M Instructions 2311.1 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_insert_blob_256_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:48:29.655798 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "1_406_342_564 (49%)",
    "node_save_v2": "864_639_056 (30%)",
}

btreemap_insert_blob_256_1024_v2
                        time:   [2853.7 M Instructions 2853.7 M Instructions 2853.7 M Instructions]
                        change: [-14.616% -14.616% -14.616%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_512_1024: Warming up for 1.0000 ms
2023-08-30 14:48:31.425479 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "2_198_537_195 (65%)",
    "node_save_v1": "455_856_248 (13%)",
}

btreemap_insert_blob_512_1024
                        time:   [3362.4 M Instructions 3362.4 M Instructions 3362.4 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_insert_blob_512_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:48:33.340004 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "2_288_282_973 (57%)",
    "node_save_v2": "967_358_344 (24%)",
}

btreemap_insert_blob_512_1024_v2
                        time:   [3965.5 M Instructions 3965.5 M Instructions 3965.5 M Instructions]
                        change: [-12.085% -12.085% -12.085%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_u64_u64: Warming up for 1.0000 ms
2023-08-30 14:48:35.250545 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "306_179_398 (35%)",
    "node_save_v1": "306_950_389 (35%)",
}

btreemap_insert_u64_u64 time:   [858.20 M Instructions 858.20 M Instructions 858.20 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_insert_u64_u64_v2: Warming up for 1.0000 ms
2023-08-30 14:48:36.545903 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "386_065_085 (39%)",
    "node_save_v2": "340_433_226 (35%)",
}

btreemap_insert_u64_u64_v2
                        time:   [967.42 M Instructions 967.42 M Instructions 967.42 M Instructions]
                        change: [+0.1004% +0.1004% +0.1004%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_insert_u64_blob_8: Warming up for 1.0000 ms
2023-08-30 14:48:37.810223 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "308_458_700 (37%)",
    "node_save_v1": "294_121_912 (35%)",
}

btreemap_insert_u64_blob_8
                        time:   [831.38 M Instructions 831.38 M Instructions 831.38 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_insert_u64_blob_8_v2: Warming up for 1.0000 ms
2023-08-30 14:48:39.024809 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "384_546_931 (41%)",
    "node_save_v2": "312_992_065 (33%)",
}

btreemap_insert_u64_blob_8_v2
                        time:   [922.26 M Instructions 922.26 M Instructions 922.26 M Instructions]
                        change: [-0.0048% -0.0048% -0.0048%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_insert_blob_8_u64: Warming up for 1.0000 ms
2023-08-30 14:48:40.303666 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "310_026_924 (41%)",
    "node_save_v1": "201_998_071 (27%)",
}

btreemap_insert_blob_8_u64
                        time:   [740.22 M Instructions 740.22 M Instructions 740.22 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_insert_blob_8_u64_v2: Warming up for 1.0000 ms
2023-08-30 14:48:41.530448 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "387_941_334 (45%)",
    "node_save_v2": "246_878_434 (28%)",
}

btreemap_insert_blob_8_u64_v2
                        time:   [859.72 M Instructions 859.72 M Instructions 859.72 M Instructions]
                        change: [-0.0040% -0.0040% -0.0040%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_get_blob_4_1024: Warming up for 1.0000 ms
2023-08-30 14:48:42.736730 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "293_795_450 (66%)",
}

btreemap_get_blob_4_1024
                        time:   [442.36 M Instructions 442.36 M Instructions 442.36 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_get_blob_4_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:48:44.444843 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "354_328_020 (69%)",
}

btreemap_get_blob_4_1024_v2
                        time:   [509.60 M Instructions 509.60 M Instructions 509.60 M Instructions]
                        change: [-26.445% -26.445% -26.445%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_8_1024: Warming up for 1.0000 ms
2023-08-30 14:48:46.143370 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "344_728_885 (66%)",
}

btreemap_get_blob_8_1024
                        time:   [520.76 M Instructions 520.76 M Instructions 520.76 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_get_blob_8_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:48:47.886753 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "402_782_460 (68%)",
}

btreemap_get_blob_8_1024_v2
                        time:   [585.59 M Instructions 585.59 M Instructions 585.59 M Instructions]
                        change: [-22.084% -22.084% -22.084%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_16_1024: Warming up for 1.0000 ms
2023-08-30 14:48:49.631589 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "425_809_809 (70%)",
}

btreemap_get_blob_16_1024
                        time:   [602.40 M Instructions 602.40 M Instructions 602.40 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_get_blob_16_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:48:51.352406 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "497_916_943 (73%)",
}

btreemap_get_blob_16_1024_v2
                        time:   [675.90 M Instructions 675.90 M Instructions 675.90 M Instructions]
                        change: [-20.032% -20.032% -20.032%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_32_1024: Warming up for 1.0000 ms
2023-08-30 14:48:53.135361 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "444_926_271 (70%)",
}

btreemap_get_blob_32_1024
                        time:   [632.59 M Instructions 632.59 M Instructions 632.59 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_get_blob_32_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:48:54.933001 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "527_746_488 (73%)",
}

btreemap_get_blob_32_1024_v2
                        time:   [716.58 M Instructions 716.58 M Instructions 716.58 M Instructions]
                        change: [-19.767% -19.767% -19.767%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_64_1024: Warming up for 1.0000 ms
2023-08-30 14:48:56.801051 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "663_035_945 (77%)",
}

btreemap_get_blob_64_1024
                        time:   [856.36 M Instructions 856.36 M Instructions 856.36 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_get_blob_64_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:48:58.630592 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "741_792_935 (78%)",
}

btreemap_get_blob_64_1024_v2
                        time:   [940.73 M Instructions 940.73 M Instructions 940.73 M Instructions]
                        change: [-16.546% -16.546% -16.546%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_128_1024: Warming up for 1.0000 ms
2023-08-30 14:49:00.571455 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "875_716_723 (81%)",
}

btreemap_get_blob_128_1024
                        time:   [1078.9 M Instructions 1078.9 M Instructions 1078.9 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_get_blob_128_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:49:02.455437 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "966_842_354 (82%)",
}

btreemap_get_blob_128_1024_v2
                        time:   [1178.0 M Instructions 1178.0 M Instructions 1178.0 M Instructions]
                        change: [-17.868% -17.868% -17.868%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_u64_u64: Warming up for 1.0000 ms
2023-08-30 14:49:04.575654 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "323_182_267 (71%)",
}

btreemap_get_u64_u64    time:   [450.17 M Instructions 450.17 M Instructions 450.17 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_get_u64_u64_v2: Warming up for 1.0000 ms
2023-08-30 14:49:06.178204 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "403_972_111 (75%)",
}

btreemap_get_u64_u64_v2 time:   [537.23 M Instructions 537.23 M Instructions 537.23 M Instructions]
                        change: [+0.0855% +0.0855% +0.0855%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_get_u64_blob_8: Warming up for 1.0000 ms
2023-08-30 14:49:07.698674 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "324_661_032 (72%)",
}

btreemap_get_u64_blob_8 time:   [446.62 M Instructions 446.62 M Instructions 446.62 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_get_u64_blob_8_v2: Warming up for 1.0000 ms
2023-08-30 14:49:09.186400 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "405_206_697 (76%)",
}

btreemap_get_u64_blob_8_v2
                        time:   [531.93 M Instructions 531.93 M Instructions 531.93 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_get_blob_8_u64: Warming up for 1.0000 ms
2023-08-30 14:49:10.720880 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "327_829_305 (70%)",
}

btreemap_get_blob_8_u64 time:   [464.82 M Instructions 464.82 M Instructions 464.82 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_get_blob_8_u64_v2: Warming up for 1.0000 ms
2023-08-30 14:49:12.118055 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "405_354_044 (74%)",
}

btreemap_get_blob_8_u64_v2
                        time:   [547.72 M Instructions 547.72 M Instructions 547.72 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_get_blob_256_1024: Warming up for 1.0000 ms
2023-08-30 14:49:13.604185 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "1_339_890_114 (85%)",
}

btreemap_get_blob_256_1024
                        time:   [1568.1 M Instructions 1568.1 M Instructions 1568.1 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_get_blob_256_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:49:15.690550 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "1_425_388_702 (85%)",
}

btreemap_get_blob_256_1024_v2
                        time:   [1665.5 M Instructions 1665.5 M Instructions 1665.5 M Instructions]
                        change: [-16.169% -16.169% -16.169%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_512_1024: Warming up for 1.0000 ms
2023-08-30 14:49:17.840464 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "2_257_152_362 (89%)",
}

btreemap_get_blob_512_1024
                        time:   [2533.8 M Instructions 2533.8 M Instructions 2533.8 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_get_blob_512_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:49:20.196568 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "2_345_085_000 (89%)",
}

btreemap_get_blob_512_1024_v2
                        time:   [2633.7 M Instructions 2633.7 M Instructions 2633.7 M Instructions]
                        change: [-12.659% -12.659% -12.659%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_4_1024: Warming up for 1.0000 ms
2023-08-30 14:49:22.692003 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "307_574_353 (28%)",
    "node_save_v1": "429_554_241 (39%)",
}

btreemap_remove_blob_4_1024
                        time:   [1078.4 M Instructions 1078.4 M Instructions 1078.4 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_remove_blob_4_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:49:24.622843 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "364_402_438 (24%)",
    "node_save_v2": "783_378_002 (52%)",
}

btreemap_remove_blob_4_1024_v2
                        time:   [1484.3 M Instructions 1484.3 M Instructions 1484.3 M Instructions]
                        change: [-16.660% -16.660% -16.660%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_8_1024: Warming up for 1.0000 ms
2023-08-30 14:49:26.502751 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "367_298_948 (26%)",
    "node_save_v1": "572_351_615 (41%)",
}

btreemap_remove_blob_8_1024
                        time:   [1381.5 M Instructions 1381.5 M Instructions 1381.5 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_remove_blob_8_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:49:28.473425 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "422_280_731 (22%)",
    "node_save_v2": "1_061_139_528 (55%)",
}

btreemap_remove_blob_8_1024_v2
                        time:   [1917.5 M Instructions 1917.5 M Instructions 1917.5 M Instructions]
                        change: [-15.404% -15.404% -15.404%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_16_1024: Warming up for 1.0000 ms
2023-08-30 14:49:30.448286 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "465_498_356 (28%)",
    "node_save_v1": "665_886_809 (40%)",
}

btreemap_remove_blob_16_1024
                        time:   [1634.9 M Instructions 1634.9 M Instructions 1634.9 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_remove_blob_16_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:49:32.565876 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "550_713_796 (23%)",
    "node_save_v2": "1_261_928_281 (54%)",
}

btreemap_remove_blob_16_1024_v2
                        time:   [2306.2 M Instructions 2306.2 M Instructions 2306.2 M Instructions]
                        change: [-14.461% -14.461% -14.461%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_32_1024: Warming up for 1.0000 ms
2023-08-30 14:49:34.635593 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "483_509_883 (28%)",
    "node_save_v1": "692_809_425 (40%)",
}

btreemap_remove_blob_32_1024
                        time:   [1709.1 M Instructions 1709.1 M Instructions 1709.1 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_remove_blob_32_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:49:36.767785 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "580_469_683 (24%)",
    "node_save_v2": "1_313_273_906 (54%)",
}

btreemap_remove_blob_32_1024_v2
                        time:   [2413.8 M Instructions 2413.8 M Instructions 2413.8 M Instructions]
                        change: [-14.744% -14.744% -14.744%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_64_1024: Warming up for 1.0000 ms
2023-08-30 14:49:38.932812 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "713_539_284 (35%)",
    "node_save_v1": "712_391_962 (35%)",
}

btreemap_remove_blob_64_1024
                        time:   [2002.7 M Instructions 2002.7 M Instructions 2002.7 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_remove_blob_64_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:49:41.105699 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "819_857_720 (29%)",
    "node_save_v2": "1_365_973_283 (49%)",
}

btreemap_remove_blob_64_1024_v2
                        time:   [2754.0 M Instructions 2754.0 M Instructions 2754.0 M Instructions]
                        change: [-13.330% -13.330% -13.330%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_128_1024: Warming up for 1.0000 ms
2023-08-30 14:49:43.339061 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "961_751_320 (41%)",
    "node_save_v1": "728_794_708 (31%)",
}

btreemap_remove_blob_128_1024
                        time:   [2326.7 M Instructions 2326.7 M Instructions 2326.7 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_remove_blob_128_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:49:45.666428 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "1_067_015_215 (34%)",
    "node_save_v2": "1_430_431_106 (45%)",
}

btreemap_remove_blob_128_1024_v2
                        time:   [3126.1 M Instructions 3126.1 M Instructions 3126.1 M Instructions]
                        change: [-13.771% -13.771% -13.771%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_256_1024: Warming up for 1.0000 ms
2023-08-30 14:49:47.977875 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "1_463_074_911 (49%)",
    "node_save_v1": "733_887_166 (24%)",
}

btreemap_remove_blob_256_1024
                        time:   [2936.5 M Instructions 2936.5 M Instructions 2936.5 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_remove_blob_256_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:49:50.424362 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "1_565_133_746 (41%)",
    "node_save_v2": "1_492_649_393 (39%)",
}

btreemap_remove_blob_256_1024_v2
                        time:   [3794.4 M Instructions 3794.4 M Instructions 3794.4 M Instructions]
                        change: [-13.960% -13.960% -13.960%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_512_1024: Warming up for 1.0000 ms
2023-08-30 14:49:52.984406 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "2_483_999_494 (58%)",
    "node_save_v1": "775_463_121 (18%)",
}

btreemap_remove_blob_512_1024
                        time:   [4235.2 M Instructions 4235.2 M Instructions 4235.2 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_remove_blob_512_1024_v2: Warming up for 1.0000 ms
2023-08-30 14:49:55.768415 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "2_590_069_393 (49%)",
    "node_save_v2": "1_697_365_632 (32%)",
}

btreemap_remove_blob_512_1024_v2
                        time:   [5262.3 M Instructions 5262.3 M Instructions 5262.3 M Instructions]
                        change: [-11.790% -11.790% -11.790%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_u64_u64: Warming up for 1.0000 ms
2023-08-30 14:49:58.686373 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "348_586_038 (28%)",
    "node_save_v1": "532_211_397 (43%)",
}

btreemap_remove_u64_u64 time:   [1214.8 M Instructions 1214.8 M Instructions 1214.8 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_remove_u64_u64_v2: Warming up for 1.0000 ms
2023-08-30 14:50:00.484403 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "434_930_666 (32%)",
    "node_save_v2": "557_017_034 (42%)",
}

btreemap_remove_u64_u64_v2
                        time:   [1325.5 M Instructions 1325.5 M Instructions 1325.5 M Instructions]
                        change: [+0.3246% +0.3246% +0.3246%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_remove_u64_blob_8: Warming up for 1.0000 ms
2023-08-30 14:50:02.172907 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "348_727_728 (29%)",
    "node_save_v1": "504_278_705 (42%)",
}

btreemap_remove_u64_blob_8
                        time:   [1174.5 M Instructions 1174.5 M Instructions 1174.5 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_remove_u64_blob_8_v2: Warming up for 1.0000 ms
2023-08-30 14:50:03.923117 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "429_769_109 (34%)",
    "node_save_v2": "510_358_326 (40%)",
}

btreemap_remove_u64_blob_8_v2
                        time:   [1260.7 M Instructions 1260.7 M Instructions 1260.7 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_remove_blob_8_u64: Warming up for 1.0000 ms
2023-08-30 14:50:05.585353 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "353_086_064 (35%)",
    "node_save_v1": "315_700_943 (32%)",
}

btreemap_remove_blob_8_u64
                        time:   [981.01 M Instructions 981.01 M Instructions 981.01 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_remove_blob_8_u64_v2: Warming up for 1.0000 ms
2023-08-30 14:50:07.541990 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "428_189_803 (38%)",
    "node_save_v2": "379_306_206 (33%)",
}

btreemap_remove_blob_8_u64_v2
                        time:   [1116.4 M Instructions 1116.4 M Instructions 1116.4 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

ielashi added 28 commits August 22, 2023 11:18
…ction in instructions)

```
Benchmarking btreemap_insert_blob_4_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:10.681469 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "3_636_501_975 (78%)",
    "node_save_v2": "621_725_540 (13%)",
}

btreemap_insert_blob_4_1024_v2
                        time:   [4614.6 M Instructions 4614.6 M Instructions 4614.6 M Instructions]
                        change: [-10.016% -10.016% -10.016%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_8_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:12.381113 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "3_888_128_011 (77%)",
    "node_save_v2": "675_563_074 (13%)",
}

btreemap_insert_blob_8_1024_v2
                        time:   [5002.9 M Instructions 5002.9 M Instructions 5002.9 M Instructions]
                        change: [-10.421% -10.421% -10.421%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_16_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:14.230071 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "3_958_532_867 (77%)",
    "node_save_v2": "709_136_673 (13%)",
}

btreemap_insert_blob_16_1024_v2
                        time:   [5115.5 M Instructions 5115.5 M Instructions 5115.5 M Instructions]
                        change: [-10.015% -10.015% -10.015%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_32_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:16.079308 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "4_095_959_285 (77%)",
    "node_save_v2": "745_609_525 (14%)",
}

btreemap_insert_blob_32_1024_v2
                        time:   [5304.5 M Instructions 5304.5 M Instructions 5304.5 M Instructions]
                        change: [-9.8505% -9.8505% -9.8505%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_64_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:17.950616 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "4_528_292_556 (77%)",
    "node_save_v2": "791_326_122 (13%)",
}

btreemap_insert_blob_64_1024_v2
                        time:   [5824.6 M Instructions 5824.6 M Instructions 5824.6 M Instructions]
                        change: [-10.047% -10.047% -10.047%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_128_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:19.897701 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "4_965_928_945 (78%)",
    "node_save_v2": "838_234_275 (13%)",
}

btreemap_insert_blob_128_1024_v2
                        time:   [6358.7 M Instructions 6358.7 M Instructions 6358.7 M Instructions]
                        change: [-9.9985% -9.9985% -9.9985%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_256_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:21.960733 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "5_411_658_559 (77%)",
    "node_save_v2": "901_162_509 (12%)",
}

btreemap_insert_blob_256_1024_v2
                        time:   [6975.5 M Instructions 6975.5 M Instructions 6975.5 M Instructions]
                        change: [-10.178% -10.178% -10.178%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_512_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:24.150752 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "6_876_355_007 (78%)",
    "node_save_v2": "1_058_462_789 (12%)",
}

btreemap_insert_blob_512_1024_v2
                        time:   [8798.0 M Instructions 8798.0 M Instructions 8798.0 M Instructions]
                        change: [-10.020% -10.020% -10.020%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_u64_u64_v2: Warming up for 1.0000 ms
2023-08-23 08:46:26.530747 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "728_775_816 (58%)",
    "node_save_v2": "258_596_339 (20%)",
}

btreemap_insert_u64_u64_v2
                        time:   [1251.5 M Instructions 1251.5 M Instructions 1251.5 M Instructions]
                        change: [-0.0037% -0.0037% -0.0037%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_insert_u64_blob_8_v2: Warming up for 1.0000 ms
2023-08-23 08:46:27.652437 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "696_823_942 (58%)",
    "node_save_v2": "247_026_223 (20%)",
}

btreemap_insert_u64_blob_8_v2
                        time:   [1187.4 M Instructions 1187.4 M Instructions 1187.4 M Instructions]
                        change: [-0.0038% -0.0038% -0.0038%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_insert_blob_8_u64_v2: Warming up for 1.0000 ms
2023-08-23 08:46:28.750840 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "758_879_496 (65%)",
    "node_save_v2": "145_886_287 (12%)",
}

btreemap_insert_blob_8_u64_v2
                        time:   [1153.0 M Instructions 1153.0 M Instructions 1153.0 M Instructions]
                        change: [-0.0037% -0.0037% -0.0037%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_get_blob_4_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:29.831699 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "4_219_207_858 (95%)",
}

btreemap_get_blob_4_1024_v2
                        time:   [4436.9 M Instructions 4436.9 M Instructions 4436.9 M Instructions]
                        change: [-11.542% -11.542% -11.542%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_8_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:32.173729 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "3_815_979_475 (94%)",
}

btreemap_get_blob_8_1024_v2
                        time:   [4044.2 M Instructions 4044.2 M Instructions 4044.2 M Instructions]
                        change: [-11.899% -11.899% -11.899%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_16_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:34.595119 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "3_851_724_650 (94%)",
}

btreemap_get_blob_16_1024_v2
                        time:   [4081.1 M Instructions 4081.1 M Instructions 4081.1 M Instructions]
                        change: [-12.053% -12.053% -12.053%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_32_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:37.017190 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "4_253_072_804 (94%)",
}

btreemap_get_blob_32_1024_v2
                        time:   [4495.5 M Instructions 4495.5 M Instructions 4495.5 M Instructions]
                        change: [-11.570% -11.570% -11.570%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_64_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:39.708213 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "4_589_519_380 (94%)",
}

btreemap_get_blob_64_1024_v2
                        time:   [4849.5 M Instructions 4849.5 M Instructions 4849.5 M Instructions]
                        change: [-11.711% -11.711% -11.711%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_128_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:42.364900 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "5_006_841_787 (94%)",
}

btreemap_get_blob_128_1024_v2
                        time:   [5272.4 M Instructions 5272.4 M Instructions 5272.4 M Instructions]
                        change: [-11.815% -11.815% -11.815%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_u64_u64_v2: Warming up for 1.0000 ms
2023-08-23 08:46:45.151204 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "768_123_966 (83%)",
}

btreemap_get_u64_u64_v2 time:   [922.10 M Instructions 922.10 M Instructions 922.10 M Instructions]
                        change: [-0.0053% -0.0053% -0.0053%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_get_u64_blob_8_v2: Warming up for 1.0000 ms
2023-08-23 08:46:46.385316 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "729_106_800 (83%)",
}

btreemap_get_u64_blob_8_v2
                        time:   [874.65 M Instructions 874.65 M Instructions 874.65 M Instructions]
                        change: [-0.0056% -0.0056% -0.0056%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_get_blob_8_u64_v2: Warming up for 1.0000 ms
2023-08-23 08:46:47.594299 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "811_967_401 (82%)",
}

btreemap_get_blob_8_u64_v2
                        time:   [987.62 M Instructions 987.62 M Instructions 987.62 M Instructions]
                        change: [-0.0049% -0.0049% -0.0049%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_get_blob_256_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:48.774213 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "5_512_886_751 (94%)",
}

btreemap_get_blob_256_1024_v2
                        time:   [5807.4 M Instructions 5807.4 M Instructions 5807.4 M Instructions]
                        change: [-12.998% -12.998% -12.998%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_512_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:51.686246 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "6_988_975_712 (95%)",
}

btreemap_get_blob_512_1024_v2
                        time:   [7330.7 M Instructions 7330.7 M Instructions 7330.7 M Instructions]
                        change: [-12.057% -12.057% -12.057%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_4_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:55.065067 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "306_221_077 (29%)",
    "node_save_v1": "416_552_416 (39%)",
}

btreemap_remove_blob_4_1024_v2
                        time:   [1055.5 M Instructions 1055.5 M Instructions 1055.5 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_remove_blob_8_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:56.830780 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "365_697_986 (27%)",
    "node_save_v1": "555_195_279 (41%)",
}

btreemap_remove_blob_8_1024_v2
                        time:   [1352.3 M Instructions 1352.3 M Instructions 1352.3 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_remove_blob_16_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:58.660166 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "4_691_318_570 (73%)",
    "node_save_v2": "1_237_620_989 (19%)",
}

btreemap_remove_blob_16_1024_v2
                        time:   [6415.9 M Instructions 6415.9 M Instructions 6415.9 M Instructions]
                        change: [-9.2624% -9.2624% -9.2624%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_32_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:47:01.495518 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "4_889_831_082 (72%)",
    "node_save_v2": "1_311_529_745 (19%)",
}

btreemap_remove_blob_32_1024_v2
                        time:   [6715.3 M Instructions 6715.3 M Instructions 6715.3 M Instructions]
                        change: [-9.0911% -9.0911% -9.0911%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_64_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:47:04.425799 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "5_090_099_125 (72%)",
    "node_save_v2": "1_381_087_495 (19%)",
}

btreemap_remove_blob_64_1024_v2
                        time:   [7031.6 M Instructions 7031.6 M Instructions 7031.6 M Instructions]
                        change: [-9.1148% -9.1148% -9.1148%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_128_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:47:07.509173 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "5_468_360_953 (72%)",
    "node_save_v2": "1_467_914_004 (19%)",
}

btreemap_remove_blob_128_1024_v2
                        time:   [7553.3 M Instructions 7553.3 M Instructions 7553.3 M Instructions]
                        change: [-8.8462% -8.8462% -8.8462%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_256_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:47:10.739864 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "6_380_810_655 (73%)",
    "node_save_v2": "1_601_556_578 (18%)",
}

btreemap_remove_blob_256_1024_v2
                        time:   [8714.6 M Instructions 8714.6 M Instructions 8714.6 M Instructions]
                        change: [-9.1626% -9.1626% -9.1626%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_512_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:47:14.235772 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "7_716_480_801 (72%)",
    "node_save_v2": "1_920_254_272 (18%)",
}

btreemap_remove_blob_512_1024_v2
                        time:   [10.603 B Instructions 10.603 B Instructions 10.603 B Instructions]
                        change: [-9.1730% -9.1730% -9.1730%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_u64_u64_v2: Warming up for 1.0000 ms
2023-08-23 08:47:18.341386 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "834_031_761 (52%)",
    "node_save_v2": "427_006_161 (27%)",
}

btreemap_remove_u64_u64_v2
                        time:   [1574.5 M Instructions 1574.5 M Instructions 1574.5 M Instructions]
                        change: [-0.0034% -0.0034% -0.0034%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_remove_u64_blob_8_v2: Warming up for 1.0000 ms
2023-08-23 08:47:19.699772 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "793_821_373 (52%)",
    "node_save_v2": "404_946_198 (27%)",
}

btreemap_remove_u64_blob_8_v2
                        time:   [1499.6 M Instructions 1499.6 M Instructions 1499.6 M Instructions]
                        change: [-0.0036% -0.0036% -0.0036%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_remove_blob_8_u64_v2: Warming up for 1.0000 ms
2023-08-23 08:47:21.052537 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "866_070_202 (60%)",
    "node_save_v2": "258_699_270 (18%)",
}

btreemap_remove_blob_8_u64_v2
                        time:   [1427.1 M Instructions 1427.1 M Instructions 1427.1 M Instructions]
                        change: [-0.0036% -0.0036% -0.0036%] (p = 0.00 < 0.05)
                        Change within noise threshold.
```
@ielashi ielashi requested review from roman-kashitsyn and a team as code owners August 30, 2023 14:56
Base automatically changed from ielashi/v2_memory_leak to main September 5, 2023 10:55
@ielashi ielashi enabled auto-merge (squash) September 5, 2023 11:34
@ielashi ielashi merged commit b7ab8f2 into main Sep 5, 2023
@ielashi ielashi deleted the ielashi/v2_page_size branch September 5, 2023 11:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants