space enlargement #9268
Labels
Comments
|
Hi @liufei26, the input SST files might not be qualified for being deleted immediately when the compaction finishes as mentioned in https://github.com/facebook/rocksdb/wiki/Delete-Stale-Files. The link also provides some general info that can be helpful. For further assistance if the wiki does not help, would you mind providing more context like log or code snippet if it's okay to do so? Thanks! |
|
hi, we are now all through the restart method, these files are deleted after the restart, is there any better solution?
…------------------ 原始邮件 ------------------
发件人: "facebook/rocksdb" ***@***.***>;
发送时间: 2021年12月9日(星期四) 上午9:14
***@***.***>;
***@***.******@***.***>;
主题: Re: [facebook/rocksdb] space enlargement (Issue #9268)
Hi @liufei26, when compaction finishes, the input SST files are replaced by the output ones in the LSM-tree. However, they may not qualify for being deleted immediately. Please see https://github.com/facebook/rocksdb/wiki/Delete-Stale-Files for more info that might be helpful to you.
If it's not, would you mind providing a bit more context like log or code snippet if it's okay to do so?
Thanks!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or unsubscribe.
Triage notifications on the go with GitHub Mobile for iOS or Android.
|
|
Hi @liufei26 - is there any criteria defined by your need for a solution to be qualified as "better" or is there any specific pain-point of the restart method that you'd like to avoid? Thanks! |
|
Yes, I'm looking for ways to avoid restarting
…------------------ 原始邮件 ------------------
发件人: "facebook/rocksdb" ***@***.***>;
发送时间: 2021年12月9日(星期四) 中午11:33
***@***.***>;
***@***.******@***.***>;
主题: Re: [facebook/rocksdb] space enlargement (Issue #9268)
Hi @liufei26 - is there any criteria defined by your need for a solution to be qualified as "better" or is there any specific pain-point of the restart method that you'd like to avoid?
Thanks!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or unsubscribe.
Triage notifications on the go with GitHub Mobile for iOS or Android.
|
Are you able to share the LOG file? I'd expect space enlargement during the compaction, but not after it completes with default options. Space enlargement during compaction can be mitigated with max_compaction_bytes. Some non-default features like slow deletion (https://github.com/facebook/rocksdb/wiki/Slow-Deletion), calling |
|
this is part of my LOG, thank you.
…------------------ 原始邮件 ------------------
发件人: "facebook/rocksdb" ***@***.***>;
发送时间: 2021年12月10日(星期五) 凌晨2:16
***@***.***>;
***@***.******@***.***>;
主题: Re: [facebook/rocksdb] space enlargement (Issue #9268)
Why is there a space enlargement after a compaction is executed, and the input file is not deleted.
Are you able to share the LOG file? I'd expect space enlargement during the compaction, but not after it completes with default options. Space enlargement during compaction can be mitigated with max_compaction_bytes.
Some non-default features like slow deletion (https://github.com/facebook/rocksdb/wiki/Slow-Deletion), calling DB::DisableFileDeletions(), or holding onto old iterators, can cause obsolete files to persist after the end of the compaction.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or unsubscribe.
Triage notifications on the go with GitHub Mobile for iOS or Android.
|
|
@ liufei26 Did you attach the log already? I couldn't see it in your latest reply "this is part of my LOG, thank you." |
|
sorry, this
…------------------ 原始邮件 ------------------
发件人: "facebook/rocksdb" ***@***.***>;
发送时间: 2021年12月10日(星期五) 中午11:31
***@***.***>;
***@***.******@***.***>;
主题: Re: [facebook/rocksdb] space enlargement (Issue #9268)
Did you attach the log already? I couldn't see it in your latest reply "this is part of my LOG, thank you."
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or unsubscribe.
Triage notifications on the go with GitHub Mobile for iOS or Android.
|
|
2021/11/12-17:54:51.465942 7f36711fe700 EVENT_LOG_v1 {"time_micros": 1636710891465935, "job": 353, "event": "table_file_deletion", "file_number": 829}
2021/11/12-17:54:51.465995 7f36711fe700 [db/compaction_picker.cc:503] [18] ***@***.*** 1+1(1153127741+420899502 bytes) to 2+1 (2227190785+420899502 bytes)
2021/11/12-17:54:51.466015 7f36711fe700 [db/compaction_job.cc:1634] [18] [JOB 354] Compacting ***@***.*** + ***@***.*** files to L4, score 1.06
2021/11/12-17:54:51.466022 7f36711fe700 [db/compaction_job.cc:1638] [18] Compaction start summary: Base version 773 Base level 3, inputs: [1271(1099MB) 1272(1024MB)], [831(401MB)]
2021/11/12-17:54:51.466045 7f36711fe700 EVENT_LOG_v1 {"time_micros": 1636710891466025, "job": 354, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L3": [1271, 1272], "files_L4": [831], "score": 1.06384, "input_data_size": 2648090287}
2021/11/12-17:54:56.144759 7f36711fe700 [db/compaction_job.cc:1323] [18] [JOB 354] Generated table #1309: 2512426 keys, 1153127741 bytes
2021/11/12-17:54:56.144809 7f36711fe700 EVENT_LOG_v1 {"time_micros": 1636710896144787, "cf_name": "18", "job": 354, "event": "table_file_creation", "file_number": 1309, "file_size": 1153127741, "table_properties": {"data_size": 1073761256, "index_size": 70966802, "filter_size": 8398868, "raw_key_size": 100497040, "raw_average_key_size": 40, "raw_value_size": 996467968, "raw_average_value_size": 396, "num_data_blocks": 16454, "num_entries": 2512426, "filter_policy_name": "rocksdb.BuiltinBloomFilter", "kDeletedKeys": "0", "kMergeOperands": "0"}}
2021/11/12-17:54:59.489615 7f36711fe700 [db/compaction_job.cc:1323] [18] [JOB 354] Generated table #1310: 2338043 keys, 1074063044 bytes
2021/11/12-17:54:59.489654 7f36711fe700 EVENT_LOG_v1 {"time_micros": 1636710899489637, "cf_name": "18", "job": 354, "event": "table_file_creation", "file_number": 1310, "file_size": 1074063044, "table_properties": {"data_size": 1000212969, "index_size": 66031468, "filter_size": 7817793, "raw_key_size": 93521720, "raw_average_key_size": 40, "raw_value_size": 928280104, "raw_average_value_size": 397, "num_data_blocks": 15326, "num_entries": 2338043, "filter_policy_name": "rocksdb.BuiltinBloomFilter", "kDeletedKeys": "0", "kMergeOperands": "0"}}
2021/11/12-17:55:00.601733 7f36711fe700 [db/compaction_job.cc:1389] [18] [JOB 354] Compacted ***@***.*** + ***@***.*** files to L4 => 2227190785 bytes
2021/11/12-17:55:00.602061 7f36711fe700 (Original Log Time 2021/11/12-17:55:00.601952) [db/compaction_job.cc:750] [18] compacted to: base level 3 max bytes base 4294967296 files[0 0 0 3 7] max score 0.55, MB/sec: 329.7 rd, 277.3 wr, level 4, files in(2, 1) out(2) MB in(2124.0, 401.4) out(2124.0), read-write-amplify(2.2) write-amplify(1.0) OK, records in: 5813611, records dropped: 963142 output_compression: NoCompression
2021/11/12-17:55:00.602070 7f36711fe700 (Original Log Time 2021/11/12-17:55:00.601988) EVENT_LOG_v1 {"time_micros": 1636710900601978, "job": 354, "event": "compaction_finished", "compaction_time_micros": 8031694, "output_level": 4, "num_output_files": 2, "total_output_size": 2227190785, "num_input_records": 5813611, "num_output_records": 4850469, "num_subcompactions": 1, "output_compression": "NoCompression", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 0, 0, 3, 7]}
2021/11/12-17:55:00.602216 7f36711fe700 EVENT_LOG_v1 {"time_micros": 1636710900602211, "job": 354, "event": "table_file_deletion", "file_number": 831}
2021/11/12-17:55:00.602255 7f36711fe700 [db/compaction_picker.cc:503] [19] ***@***.*** 1+1(1153147082+420287437 bytes) to 2+1 (2223458048+420287437 bytes)
2021/11/12-17:55:00.602271 7f36711fe700 [db/compaction_job.cc:1634] [19] [JOB 355] Compacting ***@***.*** + ***@***.*** files to L4, score 1.06
2021/11/12-17:55:00.602278 7f36711fe700 [db/compaction_job.cc:1638] [19] Compaction start summary: Base version 774 Base level 3, inputs: [1273(1099MB) 1274(1020MB)], [832(400MB)]
2021/11/12-17:55:00.602288 7f36711fe700 EVENT_LOG_v1 {"time_micros": 1636710900602281, "job": 355, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L3": [1273, 1274], "files_L4": [832], "score": 1.05798, "input_data_size": 2643745485}
2021/11/12-17:55:05.244466 7f36711fe700 [db/compaction_job.cc:1323] [19] [JOB 355] Generated table #1311: 2512836 keys, 1153147082 bytes
2021/11/12-17:55:05.244506 7f36711fe700 EVENT_LOG_v1 {"time_micros": 1636710905244486, "cf_name": "19", "job": 355, "event": "table_file_creation", "file_number": 1311, "file_size": 1153147082, "table_properties": {"data_size": 1073766493, "index_size": 70979831, "filter_size": 8399943, "raw_key_size": 100513440, "raw_average_key_size": 40, "raw_value_size": 996459312, "raw_average_value_size": 396, "num_data_blocks": 16454, "num_entries": 2512836, "filter_policy_name": "rocksdb.BuiltinBloomFilter", "kDeletedKeys": "0", "kMergeOperands": "0"}}
2021/11/12-17:55:08.617475 7f36711fe700 [db/compaction_job.cc:1323] [19] [JOB 355] Generated table #1312: 2332642 keys, 1070310966 bytes
2021/11/12-17:55:08.617515 7f36711fe700 EVENT_LOG_v1 {"time_micros": 1636710908617496, "cf_name": "19", "job": 355, "event": "table_file_creation", "file_number": 1312, "file_size": 1070310966, "table_properties": {"data_size": 996634896, "index_size": 65877953, "filter_size": 7797303, "raw_key_size": 93305680, "raw_average_key_size": 40, "raw_value_size": 924871064, "raw_average_value_size": 396, "num_data_blocks": 15271, "num_entries": 2332642, "filter_policy_name": "rocksdb.BuiltinBloomFilter", "kDeletedKeys": "0", "kMergeOperands": "0"}}
2021/11/12-17:55:09.699308 7f36711fe700 [db/compaction_job.cc:1389] [19] [JOB 355] Compacted ***@***.*** + ***@***.*** files to L4 => 2223458048 bytes
2021/11/12-17:55:09.699799 7f36711fe700 (Original Log Time 2021/11/12-17:55:09.699693) [db/compaction_job.cc:750] [19] compacted to: base level 3 max bytes base 4294967296 files[0 0 0 3 7] max score 0.54, MB/sec: 329.6 rd, 277.2 wr, level 4, files in(2, 1) out(2) MB in(2120.5, 400.8) out(2120.5), read-write-amplify(2.2) write-amplify(1.0) OK, records in: 5808010, records dropped: 962532 output_compression: NoCompression
2021/11/12-17:55:09.699808 7f36711fe700 (Original Log Time 2021/11/12-17:55:09.699730) EVENT_LOG_v1 {"time_micros": 1636710909699720, "job": 355, "event": "compaction_finished", "compaction_time_micros": 8021939, "output_level": 4, "num_output_files": 2, "total_output_size": 2223458048, "num_input_records": 5808010, "num_output_records": 4845478, "num_subcompactions": 1, "output_compression": "NoCompression", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 0, 0, 3, 7]}
2021/11/12-17:55:09.701559 7f36711fe700 EVENT_LOG_v1 {"time_micros": 1636710909701553, "job": 355, "event": "table_file_deletion", "file_number": 832}
2021/11/12-17:59:37.564469 7f3676ffe700 hashLinkedList Entry distribution among buckets: Count: 262144 Average: 0.0000 StdDev: 0.00
Min: 0 Median: 0.0000 Max: 0
Percentiles: P50: 0.00 P75: 0.00 P99: 0.00 P99.9: 0.00 P99.99: 0.00
…------------------------------------------------------
[ 0, 1 ] 262144 100.000% 100.000% ####################
2021/11/12-17:59:38.387433 7f3676ffe700 [db/external_sst_file_ingestion_job.cc:249] [AddFile] External SST file /data00/index_service_data_ingest/type_2/20211025/index.sst was ingested in L0 with path /data00/index_service_data_rocksdb/001313.sst (global_seqno=377)
2021/11/12-17:59:38.392449 7f36919ff700 [WARN] [db/db_impl.cc:534] ------- DUMPING STATS -------
2021/11/12-17:59:38.393307 7f36919ff700 [WARN] [db/db_impl.cc:535]
** DB Stats **
Uptime(secs): 18187.8 total, 641.9 interval
Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 1.78 GB 1.0 0.0 0.0 0.0 0.0 0.0 16.2 0.0 0.0 0.0 8 13 0.638 0 0
L3 2/0 2.30 GB 0.6 3.2 1.6 1.5 2.3 0.8 10.6 1.4 120.2 87.4 27 6 4.489 50M 24M
L4 5/0 5.46 GB 0.0 49.4 21.8 27.6 31.2 3.6 1.9 1.4 134.9 85.0 375 17 22.068 704M 350M
Sum 8/0 9.54 GB 0.0 52.6 23.4 29.1 33.5 4.3 28.7 1.2 131.2 83.5 410 36 11.399 755M 375M
Int 0/0 0.00 KB 0.0 5.8 2.7 3.0 3.3 0.3 1.8 1.9 199.1 115.7 30 2 14.805 47M 23M
Uptime(secs): 18187.8 total, 641.9 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 28.665, interval 1.781
AddFile(Total Files): cumulative 20, interval 1
AddFile(L0 Files): cumulative 13, interval 1
AddFile(Keys): cumulative 475397484, interval 25492978
Cumulative compaction: 33.46 GB write, 1.88 MB/s write, 52.59 GB read, 2.96 MB/s read, 410.4 seconds
Interval compaction: 3.35 GB write, 5.34 MB/s write, 5.76 GB read, 9.18 MB/s read, 29.6 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
** File Read Latency Histogram By Level [default] **
** Level 0 read latency histogram (micros):
Count: 26 Average: 7230.4231 StdDev: 5738.90
Min: 504 Median: 4185.7143 Max: 18029
Percentiles: P50: 4185.71 P75: 12770.00 P99: 18029.00 P99.9: 18029.00 P99.99: 18029.00
------------------------------------------------------
( 380, 580 ] 1 3.846% 3.846% #
( 1300, 1900 ] 2 7.692% 11.538% ##
( 1900, 2900 ] 4 15.385% 26.923% ###
( 2900, 4400 ] 7 26.923% 53.846% #####
( 4400, 6600 ] 2 7.692% 61.538% ##
( 9900, 14000 ] 5 19.231% 80.769% ####
( 14000, 22000 ] 5 19.231% 100.000% ####
** Level 3 read latency histogram (micros):
Count: 24 Average: 48338.9167 StdDev: 117571.68
Min: 113 Median: 6600.0000 Max: 526439
Percentiles: P50: 6600.00 P75: 25666.67 P99: 524400.00 P99.9: 526439.00 P99.99: 526439.00
------------------------------------------------------
( 110, 170 ] 2 8.333% 8.333% ##
( 250, 380 ] 1 4.167% 12.500% #
( 380, 580 ] 1 4.167% 16.667% #
( 580, 870 ] 1 4.167% 20.833% #
( 870, 1300 ] 3 12.500% 33.333% ###
( 1900, 2900 ] 1 4.167% 37.500% #
( 2900, 4400 ] 2 8.333% 45.833% ##
( 4400, 6600 ] 1 4.167% 50.000% #
( 9900, 14000 ] 1 4.167% 54.167% #
( 14000, 22000 ] 4 16.667% 70.833% ###
( 22000, 33000 ] 3 12.500% 83.333% ###
( 50000, 75000 ] 1 4.167% 87.500% #
( 75000, 110000 ] 1 4.167% 91.667% #
( 250000, 380000 ] 1 4.167% 95.833% #
( 380000, 570000 ] 1 4.167% 100.000% #
** Level 4 read latency histogram (micros):
Count: 200 Average: 70900.3500 StdDev: 160151.01
Min: 30 Median: 4025.0000 Max: 743427
Percentiles: P50: 4025.00 P75: 42272.73 P99: 743427.00 P99.9: 743427.00 P99.99: 743427.00
------------------------------------------------------
( 22, 34 ] 4 2.000% 2.000%
( 34, 51 ] 2 1.000% 3.000%
( 51, 76 ] 5 2.500% 5.500% #
( 76, 110 ] 3 1.500% 7.000%
( 110, 170 ] 11 5.500% 12.500% #
( 170, 250 ] 12 6.000% 18.500% #
( 250, 380 ] 4 2.000% 20.500%
( 380, 580 ] 8 4.000% 24.500% #
( 580, 870 ] 29 14.500% 39.000% ###
( 870, 1300 ] 12 6.000% 45.000% #
( 1300, 1900 ] 3 1.500% 46.500%
( 1900, 2900 ] 4 2.000% 48.500%
( 2900, 4400 ] 4 2.000% 50.500%
( 4400, 6600 ] 1 0.500% 51.000%
( 6600, 9900 ] 8 4.000% 55.000% #
( 9900, 14000 ] 9 4.500% 59.500% #
( 14000, 22000 ] 15 7.500% 67.000% ##
( 22000, 33000 ] 10 5.000% 72.000% #
( 33000, 50000 ] 11 5.500% 77.500% #
( 50000, 75000 ] 7 3.500% 81.000% #
( 75000, 110000 ] 5 2.500% 83.500% #
( 110000, 170000 ] 9 4.500% 88.000% #
( 170000, 250000 ] 5 2.500% 90.500% #
( 250000, 380000 ] 7 3.500% 94.000% #
( 380000, 570000 ] 2 1.000% 95.000%
( 570000, 860000 ] 10 5.000% 100.000% #
** Compaction Stats [0] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------
L0 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 7.6 0.0 0.0 0.0 0 16 0.030 0 0
L3 3/0 2.17 GB 0.5 10.3 3.3 7.0 10.4 3.4 0.8 3.1 353.0 356.3 30 9 3.336 15M 1
L4 7/0 6.38 GB 0.0 24.6 6.4 18.2 23.8 5.6 0.8 3.7 472.1 456.8 53 12 4.444 15M 1152K
Sum 10/0 8.55 GB 0.0 34.9 9.7 25.3 34.2 9.0 9.2 3.7 426.7 418.2 84 37 2.266 30M 1152K
Int 0/0 0.00 KB 0.0 4.5 2.5 2.0 4.1 2.1 0.4 10.1 304.4 279.1 15 3 5.062 10M 961K
Uptime(secs): 18187.8 total, 641.9 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 9.245, interval 0.408
AddFile(Total Files): cumulative 20, interval 1
AddFile(L0 Files): cumulative 16, interval 1
AddFile(Keys): cumulative 8755532, interval 990525
Cumulative compaction: 34.24 GB write, 1.93 MB/s write, 34.94 GB read, 1.97 MB/s read, 83.8 seconds
Interval compaction: 4.14 GB write, 6.60 MB/s write, 4.51 GB read, 7.20 MB/s read, 15.2 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
** File Read Latency Histogram By Level [0] **
** Level 0 read latency histogram (micros):
Count: 32 Average: 2514.0938 StdDev: 1223.44
Min: 771 Median: 2344.4444 Max: 5299
Percentiles: P50: 2344.44 P75: 3462.50 P99: 5299.00 P99.9: 5299.00 P99.99: 5299.00
------------------------------------------------------
( 580, 870 ] 3 9.375% 9.375% ##
( 870, 1300 ] 4 12.500% 21.875% ###
( 1300, 1900 ] 5 15.625% 37.500% ###
( 1900, 2900 ] 9 28.125% 65.625% ######
( 2900, 4400 ] 8 25.000% 90.625% #####
( 4400, 6600 ] 3 9.375% 100.000% ##
** Level 3 read latency histogram (micros):
Count: 103 Average: 6710.5437 StdDev: 16578.25
Min: 23 Median: 1325.0000 Max: 82514
Percentiles: P50: 1325.00 P75: 4259.38 P99: 82514.00 P99.9: 82514.00 P99.99: 82514.00
------------------------------------------------------
( 22, 34 ] 11 10.680% 10.680% ##
( 34, 51 ] 3 2.913% 13.592% #
( 51, 76 ] 7 6.796% 20.388% #
( 110, 170 ] 3 2.913% 23.301% #
( 170, 250 ] 5 4.854% 28.155% #
( 250, 380 ] 2 1.942% 30.097%
( 380, 580 ] 5 4.854% 34.951% #
( 580, 870 ] 10 9.709% 44.660% ##
( 870, 1300 ] 5 4.854% 49.515% #
( 1300, 1900 ] 12 11.650% 61.165% ##
( 1900, 2900 ] 7 6.796% 67.961% #
( 2900, 4400 ] 8 7.767% 75.728% ##
( 4400, 6600 ] 2 1.942% 77.670%
( 6600, 9900 ] 5 4.854% 82.524% #
( 9900, 14000 ] 12 11.650% 94.175% ##
( 33000, 50000 ] 1 0.971% 95.146%
( 50000, 75000 ] 1 0.971% 96.117%
( 75000, 110000 ] 4 3.883% 100.000% #
** Level 4 read latency histogram (micros):
Count: 221 Average: 3414.9774 StdDev: 8636.96
Min: 24 Median: 1129.4828 Max: 87827
Percentiles: P50: 1129.48 P75: 2668.52 P99: 21832.00 P99.9: 87827.00 P99.99: 87827.00
------------------------------------------------------
( 22, 34 ] 12 5.430% 5.430% #
( 34, 51 ] 1 0.452% 5.882%
( 51, 76 ] 10 4.525% 10.407% #
( 76, 110 ] 16 7.240% 17.647% #
( 110, 170 ] 10 4.525% 22.172% #
( 170, 250 ] 5 2.262% 24.434%
( 250, 380 ] 14 6.335% 30.769% #
( 380, 580 ] 8 3.620% 34.389% #
( 580, 870 ] 17 7.692% 42.081% ##
( 870, 1300 ] 29 13.122% 55.204% ###
( 1300, 1900 ] 23 10.407% 65.611% ##
( 1900, 2900 ] 27 12.217% 77.828% ##
( 2900, 4400 ] 16 7.240% 85.068% #
( 4400, 6600 ] 3 1.357% 86.425%
( 6600, 9900 ] 3 1.357% 87.783%
( 9900, 14000 ] 15 6.787% 94.570% #
( 14000, 22000 ] 10 4.525% 99.095% #
( 75000, 110000 ] 2 0.905% 100.000%
** Compaction Stats [1] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------
L0 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 7.6 0.0 0.0 0.0 0 16 0.028 0 0
L3 3/0 2.17 GB 0.5 10.3 3.3 7.0 10.4 3.4 0.8 3.1 360.6 364.0 29 9 3.266 15M 2
L4 7/0 6.36 GB 0.0 24.5 6.3 18.2 23.7 5.5 0.8 3.7 490.6 474.6 51 12 4.260 15M 1152K
Sum 10/0 8.53 GB 0.0 34.8 9.7 25.2 34.1 9.0 9.2 3.7 440.7 431.8 81 37 2.188 30M 1152K
Int 0/0 0.00 KB 0.0 4.5 2.5 2.0 4.1 2.1 0.4 10.1 305.1 279.7 15 3 5.050 10M 961K
Uptime(secs): 18187.8 total, 641.9 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 9.230, interval 0.409
AddFile(Total Files): cumulative 20, interval 1
AddFile(L0 Files): cumulative 16, interval 1
AddFile(Keys): cumulative 8749707, interval 990307
Cumulative compaction: 34.14 GB write, 1.92 MB/s write, 34.84 GB read, 1.96 MB/s read, 81.0 seconds
Interval compaction: 4.14 GB write, 6.60 MB/s write, 4.51 GB read, 7.20 MB/s read, 15.1 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
** File Read Latency Histogram By Level [1] **
** Level 0 read latency histogram (micros):
Count: 32 Average: 2972.2188 StdDev: 1817.43
Min: 839 Median: 2650.0000 Max: 9277
Percentiles: P50: 2650.00 P75: 3800.00 P99: 9277.00 P99.9: 9277.00 P99.99: 9277.00
------------------------------------------------------
( 580, 870 ] 1 3.125% 3.125% #
( 870, 1300 ] 4 12.500% 15.625% ###
( 1300, 1900 ] 5 15.625% 31.250% ###
( 1900, 2900 ] 8 25.000% 56.250% #####
( 2900, 4400 ] 10 31.250% 87.500% ######
( 4400, 6600 ] 2 6.250% 93.750% #
( 6600, 9900 ] 2 6.250% 100.000% #
** Level 3 read latency histogram (micros):
Count: 103 Average: 6727.0777 StdDev: 16428.70
Min: 23 Median: 1199.6667 Max: 81651
Percentiles: P50: 1199.67 P75: 4137.50 P99: 81651.00 P99.9: 81651.00 P99.99: 81651.00
------------------------------------------------------
( 22, 34 ] 8 7.767% 7.767% ##
( 34, 51 ] 2 1.942% 9.709%
( 51, 76 ] 6 5.825% 15.534% #
( 76, 110 ] 4 3.883% 19.417% #
( 110, 170 ] 1 0.971% 20.388%
( 170, 250 ] 3 2.913% 23.301% #
( 250, 380 ] 3 2.913% 26.214% #
( 380, 580 ] 4 3.883% 30.097% #
( 580, 870 ] 9 8.738% 38.835% ##
( 870, 1300 ] 15 14.563% 53.398% ###
( 1300, 1900 ] 9 8.738% 62.136% ##
( 1900, 2900 ] 5 4.854% 66.990% #
( 2900, 4400 ] 10 9.709% 76.699% ##
( 4400, 6600 ] 1 0.971% 77.670%
( 6600, 9900 ] 4 3.883% 81.553% #
( 9900, 14000 ] 12 11.650% 93.204% ##
( 14000, 22000 ] 1 0.971% 94.175%
( 33000, 50000 ] 1 0.971% 95.146%
( 50000, 75000 ] 2 1.942% 97.087%
( 75000, 110000 ] 3 2.913% 100.000% #
** Level 4 read latency histogram (micros):
Count: 221 Average: 3287.3937 StdDev: 8885.15
Min: 23 Median: 1024.5312 Max: 90065
Percentiles: P50: 1024.53 P75: 2313.46 P99: 21847.27 P99.9: 90065.00 P99.99: 90065.00
------------------------------------------------------
( 22, 34 ] 8 3.620% 3.620% #
( 34, 51 ] 5 2.262% 5.882%
( 51, 76 ] 13 5.882% 11.765% #
( 76, 110 ] 10 4.525% 16.290% #
( 110, 170 ] 8 3.620% 19.910% #
( 170, 250 ] 10 4.525% 24.434% #
( 250, 380 ] 14 6.335% 30.769% #
( 380, 580 ] 12 5.430% 36.199% #
( 580, 870 ] 19 8.597% 44.796% ##
( 870, 1300 ] 32 14.480% 59.276% ###
( 1300, 1900 ] 24 10.860% 70.136% ##
( 1900, 2900 ] 26 11.765% 81.900% ##
( 2900, 4400 ] 8 3.620% 85.520% #
( 4400, 6600 ] 5 2.262% 87.783%
( 9900, 14000 ] 14 6.335% 94.118% #
( 14000, 22000 ] 11 4.977% 99.095% #
( 75000, 110000 ] 2 0.905% 100.000%
** Compaction Stats [2] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------
L0 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 7.6 0.0 0.0 0.0 0 16 0.024 0 0
L3 3/0 2.17 GB 0.5 10.4 3.3 7.0 10.5 3.4 0.8 3.2 359.6 363.0 30 9 3.279 15M 1
L4 7/0 6.36 GB 0.0 24.5 6.3 18.1 23.7 5.5 0.8 3.7 479.0 463.4 52 12 4.360 15M 1155K
Sum 10/0 8.53 GB 0.0 34.8 9.7 25.2 34.1 9.0 9.2 3.7 433.9 425.2 82 37 2.222 30M 1155K
Int 0/0 0.00 KB 0.0 4.5 2.5 2.0 4.1 2.1 0.4 10.1 307.8 282.2 15 3 5.013 10M 963K
Uptime(secs): 18187.8 total, 641.9 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 9.233, interval 0.409
AddFile(Total Files): cumulative 20, interval 1
AddFile(L0 Files): cumulative 16, interval 1
AddFile(Keys): cumulative 8763155, interval 991945
Cumulative compaction: 34.14 GB write, 1.92 MB/s write, 34.84 GB read, 1.96 MB/s read, 82.2 seconds
Interval compaction: 4.14 GB write, 6.61 MB/s write, 4.52 GB read, 7.21 MB/s read, 15.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
** File Read Latency Histogram By Level [2] **
** Level 0 read latency histogram (micros):
Count: 32 Average: 3486.6250 StdDev: 1344.69
Min: 856 Median: 3610.5263 Max: 7427
Percentiles: P50: 3610.53 P75: 4242.11 P99: 7427.00 P99.9: 7427.00 P99.99: 7427.00
------------------------------------------------------
( 580, 870 ] 1 3.125% 3.125% #
( 870, 1300 ] 1 3.125% 6.250% #
( 1300, 1900 ] 3 9.375% 15.625% ##
( 1900, 2900 ] 2 6.250% 21.875% #
( 2900, 4400 ] 19 59.375% 81.250% ############
( 4400, 6600 ] 5 15.625% 96.875% ###
( 6600, 9900 ] 1 3.125% 100.000% #
** Level 3 read latency histogram (micros):
Count: 103 Average: 6917.6893 StdDev: 17259.20
Min: 23 Median: 1118.0769 Max: 88504
Percentiles: P50: 1118.08 P75: 4025.00 P99: 88504.00 P99.9: 88504.00 P99.99: 88504.00
------------------------------------------------------
( 22, 34 ] 7 6.796% 6.796% #
( 34, 51 ] 3 2.913% 9.709% #
( 51, 76 ] 5 4.854% 14.563% #
( 76, 110 ] 5 4.854% 19.417% #
( 110, 170 ] 2 1.942% 21.359%
( 170, 250 ] 4 3.883% 25.243% #
( 250, 380 ] 3 2.913% 28.155% #
( 380, 580 ] 5 4.854% 33.010% #
( 580, 870 ] 10 9.709% 42.718% ##
( 870, 1300 ] 13 12.621% 55.340% ###
( 1300, 1900 ] 10 9.709% 65.049% ##
( 1900, 2900 ] 5 4.854% 69.903% #
( 2900, 4400 ] 7 6.796% 76.699% #
( 4400, 6600 ] 2 1.942% 78.641%
( 6600, 9900 ] 3 2.913% 81.553% #
( 9900, 14000 ] 10 9.709% 91.262% ##
( 14000, 22000 ] 3 2.913% 94.175% #
( 33000, 50000 ] 1 0.971% 95.146%
( 50000, 75000 ] 1 0.971% 96.117%
( 75000, 110000 ] 4 3.883% 100.000% #
** Level 4 read latency histogram (micros):
Count: 221 Average: 3283.1222 StdDev: 8505.18
Min: 23 Median: 1148.7037 Max: 85662
Percentiles: P50: 1148.70 P75: 2517.19 P99: 21847.27 P99.9: 85662.00 P99.99: 85662.00
------------------------------------------------------
( 22, 34 ] 14 6.335% 6.335% #
( 34, 51 ] 3 1.357% 7.692%
( 51, 76 ] 10 4.525% 12.217% #
( 76, 110 ] 9 4.072% 16.290% #
( 110, 170 ] 14 6.335% 22.624% #
( 170, 250 ] 8 3.620% 26.244% #
( 250, 380 ] 11 4.977% 31.222% #
( 380, 580 ] 10 4.525% 35.747% #
( 580, 870 ] 14 6.335% 42.081% #
( 870, 1300 ] 27 12.217% 54.299% ##
( 1300, 1900 ] 26 11.765% 66.063% ##
( 1900, 2900 ] 32 14.480% 80.543% ###
( 2900, 4400 ] 15 6.787% 87.330% #
( 6600, 9900 ] 2 0.905% 88.235%
( 9900, 14000 ] 13 5.882% 94.118% #
( 14000, 22000 ] 11 4.977% 99.095% #
( 75000, 110000 ] 2 0.905% 100.000%
rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.db.write.stall P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.sst.read.micros P50 : 1261.225124 P95 : 18089.361702 P99 : 98422.844828 P100 : 743427.000000 COUNT : 7337 SUM : 45505905
rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 1 SUM : 0
rocksdb.bytes.per.write P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.gc.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.db.flush.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
2021/11/12-17:59:38.405777 7f3676ffe700 [db/external_sst_file_ingestion_job.cc:249] [AddFile] External SST file /data00/index_service_data_ingest/type_2/20211025/0/action.sst was ingested in L0 with path /data00/index_service_data_rocksdb/001314.sst (global_seqno=378)
2021/11/12-17:59:38.405844 7f36919ff700 [db/compaction_job.cc:1634] [default] [JOB 356] Compacting ***@***.*** + ***@***.*** files to L3, score 1.00
2021/11/12-17:59:38.405863 7f36919ff700 [db/compaction_job.cc:1638] [default] Compaction start summary: Base version 794 Base level 0, inputs: [1313(1823MB)], [1004(1471MB) 1021(882MB)]
2021/11/12-17:59:38.405887 7f36919ff700 EVENT_LOG_v1 {"time_micros": 1636711178405873, "job": 356, "event": "compaction_started", "compaction_reason": "LevelL0FilesNum", "files_L0": [1313], "files_L3": [1004, 1021], "score": 1, "input_data_size": 4380192882}
2021/11/12-17:59:38.415934 7f3676ffe700 hashLinkedList Entry distribution among buckets: Count: 262144 Average: 0.0000 StdDev: 0.00
Min: 0 Median: 0.0000 Max: 0
Percentiles: P50: 0.00 P75: 0.00 P99: 0.00 P99.9: 0.00 P99.99: 0.00
------------------------------------------------------
[ 0, 1 ] 262144 100.000% 100.000% ####################
2021/11/12-17:59:38.422686 7f3676ffe700 [db/external_sst_file_ingestion_job.cc:249] [AddFile] External SST file /data00/index_service_data_ingest/type_2/20211025/1/action.sst was ingested in L0 with path /data00/index_service_data_rocksdb/001315.sst (global_seqno=379)
2021/11/12-17:59:38.428305 7f3676ffe700 hashLinkedList Entry distribution among buckets: Count: 262144 Average: 0.0000 StdDev: 0.00
Min: 0 Median: 0.0000 Max: 0
Percentiles: P50: 0.00 P75: 0.00 P99: 0.00 P99.9: 0.00 P99.99: 0.00
------------------------------------------------------
[ 0, 1 ] 262144 100.000% 100.000% ####################
2021/11/12-17:59:38.435329 7f3676ffe700 [db/external_sst_file_ingestion_job.cc:249] [AddFile] External SST file /data00/index_service_data_ingest/type_2/20211025/2/action.sst was ingested in L0 with path /data00/index_service_data_rocksdb/001316.sst (global_seqno=380)
2021/11/12-17:59:38.445091 7f3676ffe700 hashLinkedList Entry distribution among buckets: Count: 262144 Average: 0.0000 StdDev: 0.00
Min: 0 Median: 0.0000 Max: 0
Percentiles: P50: 0.00 P75: 0.00 P99: 0.00 P99.9: 0.00 P99.99: 0.00
------------------------------------------------------
[ 0, 1 ] 262144 100.000% 100.000% ####################
2021/11/12-17:59:38.453809 7f3676ffe700 [db/external_sst_file_ingestion_job.cc:249] [AddFile] External SST file /data00/index_service_data_ingest/type_2/20211025/3/action.sst was ingested in L0 with path /data00/index_service_data_rocksdb/001317.sst (global_seqno=381)
2021/11/12-17:59:38.465381 7f3676ffe700 hashLinkedList Entry distribution among buckets: Count: 262144 Average: 0.0000 StdDev: 0.00
Min: 0 Median: 0.0000 Max: 0
Percentiles: P50: 0.00 P75: 0.00 P99: 0.00 P99.9: 0.00 P99.99: 0.00
[ 0, 1 ] 262144 100.000% 100.000% ####################
2021/11/12-17:59:39.242103 7f3676ffe700 [db/external_sst_file_ingestion_job.cc:249] [AddFile] External SST file /data00/index_service_data_ingest/type_2/20211025/15/action.sst was ingested in L0 with path /data00/index_service_data_rocksdb/001329.sst (global_seqno=393)
2021/11/12-17:59:39.248152 7f3676ffe700 hashLinkedList Entry distribution among buckets: Count: 262144 Average: 0.0000 StdDev: 0.00
Min: 0 Median: 0.0000 Max: 0
Percentiles: P50: 0.00 P75: 0.00 P99: 0.00 P99.9: 0.00 P99.99: 0.00
------------------------------------------------------
[ 0, 1 ] 262144 100.000% 100.000% ####################
2021/11/12-17:59:39.251565 7f3676ffe700 [db/external_sst_file_ingestion_job.cc:249] [AddFile] External SST file /data00/index_service_data_ingest/type_2/20211025/16/action.sst was ingested in L0 with path /data00/index_service_data_rocksdb/001330.sst (global_seqno=394)
2021/11/12-17:59:39.257158 7f3676ffe700 hashLinkedList Entry distribution among buckets: Count: 262144 Average: 0.0000 StdDev: 0.00
Min: 0 Median: 0.0000 Max: 0
Percentiles: P50: 0.00 P75: 0.00 P99: 0.00 P99.9: 0.00 P99.99: 0.00
------------------------------------------------------
[ 0, 1 ] 262144 100.000% 100.000% ####################
2021/11/12-17:59:39.261379 7f3676ffe700 [db/external_sst_file_ingestion_job.cc:249] [AddFile] External SST file /data00/index_service_data_ingest/type_2/20211025/17/action.sst was ingested in L0 with path /data00/index_service_data_rocksdb/001331.sst (global_seqno=395)
2021/11/12-17:59:39.267055 7f3676ffe700 hashLinkedList Entry distribution among buckets: Count: 262144 Average: 0.0000 StdDev: 0.00
Min: 0 Median: 0.0000 Max: 0
Percentiles: P50: 0.00 P75: 0.00 P99: 0.00 P99.9: 0.00 P99.99: 0.00
------------------------------------------------------
[ 0, 1 ] 262144 100.000% 100.000% ####################
2021/11/12-17:59:39.270167 7f3676ffe700 [db/external_sst_file_ingestion_job.cc:249] [AddFile] External SST file /data00/index_service_data_ingest/type_2/20211025/18/action.sst was ingested in L0 with path /data00/index_service_data_rocksdb/001332.sst (global_seqno=396)
2021/11/12-17:59:39.275321 7f3676ffe700 hashLinkedList Entry distribution among buckets: Count: 262144 Average: 0.0000 StdDev: 0.00
Min: 0 Median: 0.0000 Max: 0
Percentiles: P50: 0.00 P75: 0.00 P99: 0.00 P99.9: 0.00 P99.99: 0.00
------------------------------------------------------
[ 0, 1 ] 262144 100.000% 100.000% ####################
2021/11/12-17:59:39.279072 7f3676ffe700 [db/external_sst_file_ingestion_job.cc:249] [AddFile] External SST file /data00/index_service_data_ingest/type_2/20211025/19/action.sst was ingested in L0 with path /data00/index_service_data_rocksdb/001333.sst (global_seqno=397)
2021/11/12-17:59:54.978885 7f36919ff700 [db/compaction_job.cc:1323] [default] [JOB 356] Generated table #1334: 14644550 keys, 1504647775 bytes
2021/11/12-17:59:54.978931 7f36919ff700 EVENT_LOG_v1 {"time_micros": 1636711194978914, "cf_name": "default", "job": 356, "event": "table_file_creation", "file_number": 1334, "file_size": 1504647775, "table_properties": {"data_size": 1073776780, "index_size": 410444723, "filter_size": 20425449, "raw_key_size": 351469200, "raw_average_key_size": 24, "raw_value_size": 762102456, "raw_average_value_size": 52, "num_data_blocks": 16402, "num_entries": 14644550, "filter_policy_name": "rocksdb.BuiltinBloomFilter", "kDeletedKeys": "0", "kMergeOperands": "0"}}
2021/11/12-18:00:06.988522 7f36919ff700 [db/compaction_job.cc:1323] [default] [JOB 356] Generated table #1335: 11122957 keys, 1142770425 bytes
2021/11/12-18:00:06.988572 7f36919ff700 EVENT_LOG_v1 {"time_micros": 1636711206988553, "cf_name": "default", "job": 356, "event": "table_file_creation", "file_number": 1335, "file_size": 1142770425, "table_properties": {"data_size": 815551943, "index_size": 311703926, "filter_size": 15513736, "raw_key_size": 266950968, "raw_average_key_size": 24, "raw_value_size": 578828100, "raw_average_value_size": 52, "num_data_blocks": 12457, "num_entries": 11122957, "filter_policy_name": "rocksdb.BuiltinBloomFilter", "kDeletedKeys": "0", "kMergeOperands": "0"}}
2021/11/12-18:00:13.641776 7f36919ff700 [db/compaction_job.cc:1389] [default] [JOB 356] Compacted ***@***.*** + ***@***.*** files to L3 => 2647418200 bytes
2021/11/12-18:00:13.650462 7f36919ff700 (Original Log Time 2021/11/12-18:00:13.642083) [db/compaction_job.cc:750] [default] compacted to: base level 3 max bytes base 4294967296 files[0 0 0 2 5] max score 0.62, MB/sec: 153.1 rd, 92.6 wr, level 3, files in(1, 2) out(2) MB in(1823.7, 2353.5) out(2524.8), read-write-amplify(3.7) write-amplify(1.4) OK, records in: 51010804, records dropped: 25243297 output_compression: NoCompression
2021/11/12-18:00:13.650471 7f36919ff700 (Original Log Time 2021/11/12-18:00:13.642120) EVENT_LOG_v1 {"time_micros": 1636711213642109, "job": 356, "event": "compaction_finished", "compaction_time_micros": 28604704, "output_level": 3, "num_output_files": 2, "total_output_size": 2647418200, "num_input_records": 51010804, "num_output_records": 25767507, "num_subcompactions": 1, "output_compression": "NoCompression", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 0, 0, 2, 5]}
2021/11/12-18:00:13.650839 7f3688bff700 [db/compaction_job.cc:1634] [0] [JOB 357] Compacting ***@***.*** + ***@***.*** files to L3, score 1.00
2021/11/12-18:00:13.650864 7f3688bff700 [db/compaction_job.cc:1638] [0] Compaction start summary: Base version 795 Base level 0, inputs: [1314(415MB)], [1022(1038MB) 1023(1038MB) 1024(143MB)]
2021/11/12-18:00:13.650900 7f3688bff700 EVENT_LOG_v1 {"time_micros": 1636711213650880, "job": 357, "event": "compaction_started", "compaction_reason": "LevelL0FilesNum", "files_L0": [1314], "files_L3": [1022, 1023, 1024], "score": 1, "input_data_size": 2765330582}
2021/11/12-18:00:15.879536 7f3688bff700 [db/compaction_job.cc:1323] [0] [JOB 357] Generated table #1336: 429736 keys, 1089463282 bytes
2021/11/12-18:00:15.879571 7f3688bff700 EVENT_LOG_v1 {"time_micros": 1636711215879557, "cf_name": "0", "job": 357, "event": "table_file_creation", "file_number": 1336, "file_size": 1089463282, "table_properties": {"data_size": 1073774602, "index_size": 12499901, "filter_size": 3187967, "raw_key_size": 17189440, "raw_average_key_size": 40, "raw_value_size": 1058948681, "raw_average_value_size": 2464, "num_data_blocks": 16525, "num_entries": 429736, "filter_policy_name": "rocksdb.BuiltinBloomFilter", "kDeletedKeys": "0", "kMergeOperands": "0"}}
2021/11/12-18:00:18.049197 7f3688bff700 [db/compaction_job.cc:1323] [0] [JOB 357] Generated table #1337: 429893 keys, 1089441988 bytes
2021/11/12-18:00:18.049238 7f3688bff700 EVENT_LOG_v1 {"time_micros": 1636711218049221, "cf_name": "0", "job": 357, "event": "table_file_creation", "file_number": 1337, "file_size": 1089441988, "table_properties": {"data_size": 1073752671, "index_size": 12500326, "filter_size": 3188179, "raw_key_size": 17195720, "raw_average_key_size": 40, "raw_value_size": 1058917876, "raw_average_value_size": 2463, "num_data_blocks": 16517, "num_entries": 429893, "filter_policy_name": "rocksdb.BuiltinBloomFilter", "kDeletedKeys": "0
|
|
@liufei26 - just realized my idea of copy-and-pasting the info log is probably a bad idea cuz it messed up the format a bit :p Would you mind attaching the LOG as a file from this issue page instead? Good thing though is at least we did see some of your log. Thanks! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Expected behavior
compaction and input file is deleted.
Actual behavior
Why is there a space enlargement after a compaction is executed, and the input file is not deleted.
Steps to reproduce the behavior
full compaction
The text was updated successfully, but these errors were encountered: