-
Notifications
You must be signed in to change notification settings - Fork 6.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Use size hint for HashMap in multiGet #1344
Conversation
For every multiGet call, a HashMap is ultimately created and returned to the caller. This HashMap is never created with a capacity hint, meaning that resizes during map buildup is likely. We know the upper bound on the number of items that will be placed in the map (`values.length`) which we can use to size the map appropriately on creation. `values.length` is only an upper bound though because some entries in `values` can be null.
Thank you for your pull request and welcome to our community. We require contributors to sign our Contributor License Agreement, and we don't seem to have you on file. In order for us to review and merge your code, please sign up at https://code.facebook.com/cla - and if you have received this in error or have any questions, please drop us a line at cla@fb.com. Thanks! |
I'm making this contribution on behalf of my employer (LinkedIn); I'll need to check CLA stuff first. I think we have a company CLA with Facebook, but I'll need to check. |
@Valloric thanks for your contribution. there are a bunch of people at linkedin who submit code changes to rocksdb, and I believe that they have signed the CLA. But please check with them to verify. |
@dhruba Yep, I know some of my co-workers have sent RocksDB patches. I've emailed the relevant people to ask about the CLA stuff. In the mean time, could I get a review of the PR when you find some time? If we can parallelize some of this stuff, that would be great. Thanks for working on RocksDB! We love it to bits. |
PR looking good. |
I looked at the Travis failures and they're all on Mac (all Linux runs were good) and they all failed on some C++ code I didn't touch. Looks like a flake. Compiler error included below: db/db_impl.cc:3690:13: error: no matching function for call to 'min'
bsize = std::min(bsize, db_options_.max_total_wal_size); |
The Mac failure is unrelated and we are fixing it. |
Still working out the CLA stuff. Might take a while. Sorry for the delay. |
I've been informed by our lawyers that I can't make this change. Apologies for the confusion. |
fea6fdd Fix @see in two Java functions (#1396) b1031d6 Remove function local statics that interfere with memory pooling (#1392) f470540 Handle WAL deletion when using avoid_flush_during_recovery e29d3b6 Make max_background_compactions and base_background_compactions dynamic changeable 21e8dac fix assertion failure in Prev() b9311aa Implement WinRandomRW file and improve code reuse (#1388) a249a0b check_format_compatible.sh to use some branch which allows to run with GCC 4.8 (#1393) 040328a Remove an assertion for single-delete in MergeHelper::MergeUntil 8cbe3e1 Relax the acceptable bias RateLimiterTest::Rate test be 25% f26a139 Log successful AddFile 5691a1d Fix compaction conflict with running compaction 017de66 fixup commit 1b7af5f Redo handling of recycled logs in full purge 27bfe32 Editorial change to README.md 89cc404 A bit of doc restructuring 9e7fda8 Fix arcanist 2e4b5ca Add missing RateLimiter class to the Windows build (#1382) ce4963f [doc] Document that Visual Studio 2015+ is now required for Windows builds (#1389) e489270 Fix scoped arena iterator (#1387) f8d8cf5 Fix log_write_bench -bytes_per_sync option. (#1375) 02b3e39 Make txn->GetState() const 447f171 new Prev() prefix support using SeekForPrev() 991b585 More block cache tickers d6ae6de Add Statistics::getAndResetTickerCount(). aea3ce4 Avoid string CONCAT which is not supported in cmake 2.6 (#1383) 2ad68b9 Support running consistency checks in release mode 67501cf Fix -ve std::string::resize 04b02dd Testing asset links after config change 8c55bb8 Make Lock Info test multiple column families d062328 Revert "Support SST files with Global sequence numbers" 5cd2883 [RocksJava] Adjusted RateLimiter to 3.10.0 (#1368) 37737c3 Expose Transaction State Publicly 2c1f952 Add facility to write only a portion of WriteBatch to WAL 043cb62 Fix record_size in log_write_bench, swap args to std::string::assign. (#1373) 4985f60 env_mirror: fix a few leaks (#1363) 5aded67 update of c.h (#1371) 912aec1 "Recent Posts" -> "All Posts" 7cbb298 Make sure that when contribtuing we call out creating appropriate directories a06ad47 Add top level doc information to CONTRIBUTING.md 3fdd5b9 A little more generic CONTRIBUTING.md ed4fc31 Add link to CONTRIBUTING.md to main docs README.md e4922e1 Forgot to truncate one blog post 6d8cd7e Add CONTRIBUTING.md for rocksdb.org contribution guidance bd55e5a Fix some formatting of compaction blog post 0f60358 CRLF -> LF mod (including removing trailing whitespace for those files) b90e29c Truncate posts on the main /blog/ page 0d7acad Add author fields to blog posts 01be441 Add GitHub link to the landing page header 9d6c961 Fix Mac build ab01da5 Support SST files with Global sequence numbers d346ba2 Minor fixes around Windows 64 Java Artifacts (#1366) e91b4d0 Add factory method for creating persistent cache that is accessible from public be1f109 Expose transaction id, lock state information and transaction wait information 6009c47 Store range tombstones in memtable 3c21c64 Use size hint for HashMap in multiGet. Similar to facebook/rocksdb#1344 (#1367) 13f7a01 Fixing JNI release build for gcc (rust-rocksdb#975) 7260662 Add Java API for SstFileWriter 2638824 delete unused variable for PrevInterval() 87dfc1d Fix conflict between AddFile() and CompactRange() eb44ed6 Update 2016-09-28-rocksdb-4-11-2-released.markdown e443761 Update 2016-09-28-rocksdb-4-11-2-released.markdown 501f051 Update 2016-09-28-rocksdb-4-11-2-released.markdown dec9009 Update 2016-09-28-rocksdb-4-11-2-released.markdown 4ed69dd Create 2016-09-28-rocksdb-4-11-2-released.markdown 21f4bb5 cmake support for linux and osx (#1358) 4defe30 fix typo in comments (#1360) f517d9d Add SeekForPrev() to Iterator eb3894c Recompute compaction score on SetOptions (#1346) 5c64fb6 Fix AddFile() conflict with compaction output [WaitForAddFile()] 9e9f5a0 Fix CompactFilesTest.ObsoleteFiles timeout (#1353) c2a62a4 not cut compaction output when compact to level 0 9ed928e Split DBOptions into ImmutableDBOptions and MutableDBOptions 4bc8c88 Recover same sequence id from WAL (#1350) 0a1bd9c add cfh deletion started listener da5a9a6 Fix mac build d45eb6c Fix typo (#1349) abc0ae4 Add AddFile() InternalStats for Total files/L0 files/total keys ingested 7152563 forbid merge during recovery 5735b3d Fix compiling under -Werror=missing-field-initializers 654ed9a loose the assertion condition of rate_limiter_test e4d3f5d Fix DBImpl::GetWalPreallocateBlockSize Mac build error 7afbb74 solve the problem of table_factory_to_write_=nullptr (#1342) d78a440 DBImpl::GetWalPreallocateBlockSize() should return size_t 42ac9c5 Retry getting arcanist token on failure b666f85 Consider more factors when determining preallocation size of WAL files 4c3f449 Add TableBuilderOptions::level and relevant changes (#1335) 3edb946 Avoid hard-coded sleep in EnvPosixTestWithParam.TwoPools 0a88f38 Remove ColumnFamilyData::options() 41a9070 Fix java makefile dependencies 8d9bf5c Fix DBOptionsTest.GetLatestOptions 40cfa3e Fix DBWALTest.RecoveryWithLogDataForSomeCFs with mac 06b4785 Fix recovery for WALs without data for all CFs d7242ff Fix GetSortedWalFiles when log recycling enabled 17f76fc DB::GetOptions() reflect dynamic changed options 215d128 Fix typo (rust-rocksdb#903) a958c26 Rename jvalue to jval in rocksjni 0a165bd Have Facebook link point to RocksDB on FB 3639f32 Fix bug in UnScSigned-off-by: xh931076284 <931076284@qq.com> (#1336) 8e061f9 Refactor GetMutableOptionsFromStrings 81747f1 Refactor MutableCFOptions ba65c81 Support POSIX RandomRWFile 1d980a8 Create CNAME 2adab1d Add API links to the header bar a182b29 Preserve blog comments in markdown f54de92 Adding Dgraph to list of Users (#1291) 9e4aa79 Summary: (#1313) a10e8a0 Fix C api memtable rep bugs. (#1328) eb1d4d5 Release RocksDB 4.12 22d88e2 Allow an offset as well as a length to be specified for byte[] operations in RocksJava JNI (#1264) b06b191 add C api for set wal_recovery_mode (#1327) 1cca091 Temporarily revert Prev() prefix support de28a25 Update HISTORY.md for thread-local stats 0fcb6db Remove extraneous function prototypes from c.h (#1326) 52ee07b Move AddFile() tests to external_sst_file_test.cc 66a91e2 Add NoSpace subcode to IOError (#1320) 67036c0 Fix Flaky ColumnFamilyTest.FlushCloseWALFiles 0e2da49 fix typo in option.h's comment (#1321) 6d61358 Add real Google Analytics ID 2d9d36e Have "Edit on GitHub" point to master instead of gh-pages 9377518 Update landing page content 1ec75ee Add redirects from old blog posts link to new format 607628d Support ZSTD with finalized format ce1be2c Fix build error on Windows (AppVeyor) (#1315) f7669b4 Fix Windows Build 22696b0 Fix uninitlized CompactionJob::SubcompactionState::current_output_file_size c1865e0 Trigger more tests per diff a88677d Remove ImmutableCFOptions from public API 80c7559 Fix data race in AddFile() with multiple files + custom comparator bug 5051755 Fix db_bench memory use after free (detected by clang_analyze) 4fd08f4 Ensure Correct Behavior of StatsLevel kExceptDetailedTimers and kExceptTimeForMutex (#1308) e14fbaa Add FAQ based on the front page of the current rocksdb.org 3c22624 Migrate the RocksDB Worpdress blog over to Jekyll ee0e220 Transfer the current Getting Started contents to GitHub Pages 5a0e9a4 Initial Landing Page 9447a85 Remove the `doc` directory 3214905 Merge options source_compaction_factor, max_grandparent_overlap_bytes and expanded_compaction_factor into max_compaction_bytes 4590b53 add stats to Cache::LookUp() 85bb308 Expose Utility function StringToMap() (#1306) 8ce1b84 Fix Travis on Mac 380e651 Fix Mac build failure (#1309) 1613fa9 Thread-specific histogram statistics 6a14d55 add prefix_seek_mode to db_iter_test de47e2b Fix ClockCache memory leak f099af4 Fix travis db74b1a fix bug in merge_iterator when data race happens b18f9c9 add nullptr check to internal_prefix_transform 4e395e8 Update docs README.md 2482d5f support Prev() in prefix seek mode 7541c7a Fix cache_test valgrind_check failure c8513cd Update the download location of Snappy (#1304) b49b92c Introduce Read amplification bitmap (read amp statistics) c700484 store prefix_extractor_name in table 4ad928e add comment to SimCache to estimate actual capacity e9b2af8 Expose ThreadPool under include/rocksdb/threadpool.h 23a0570 Document memtable flush behavior in CancelAllBackgroundWork() dade61a Mitigate regression bug of options.max_successive_merges hit during DB Recovery cce702a [db_bench] Support single benchmark arguments (Repeat for X times, Warm up for X times), Support CombinedStats (AVG / MEDIAN) 3586901 cat tests logs sorted by exit code b2ce595 Persist data during user initiated shutdown 4b3438d Fix parallel valgrind (valgrind_check) a081f79 Relax consistency for thread-local ticker stats b10d65c Update and slightly clarify instructions in build_detect_platform (#1301) f85f99b Fix the Windows build of RocksDB Java. Similar to facebook/rocksdb#1220 (#1284) 7b81095 Fix a crash when compaction fails to open a file 7c95868 Thread-specific ticker statistics ea9e075 Add initial GitHub pages infra for RocksDB documentation move and update. (#1294) 2a9c971 [Flaky Test] Disable DBPropertiesTest.GetProperty d76ddf3 Disable ClockCache db_crashtest cec2c64 fix data race in NewIndexIterator() in block_based_table_reader.cc badbff6 Not insert into block cache if cache is full and not holding handle 4a16c32 Option to cache index/filter blocks with priority 99c4af7 Make ClockCache available with TSAN build f57bc1d Fix lambda expression for clang/windows 5440675 Fix lambda capture expression for windows 6584cec Fold function for thread-local data 817eeb2 Add singleDelete to RocksJava (#1275) ffdf6ee Add Status to RocksDBException so that meaningful function result Status from the C++ API isn't lost (#1273) ecf9003 Fix bug in printing values for block-based table 72f8cc7 LRU cache mid-point insertion 6a17b07 Add TablePropertiesCollector support in SstFileWriter 78837f5 TableBuilder / TableReader support for range deletion 4cc37f5 Introduce ClockCache ff17a2a Adding TBB as dependency. 49d88be c abi: allow compaction filter ignore snapshot (#1268) 0b63f51 fixes 1215: execute_process(COMMAND mkdir ${DIR}) fails to create a directory with cmake on Windows (#1219) 3981345 Small nits (#1280) 2a2ebb6 Move LRUCache structs to lru_cache.h header 2fc2fd9 Single Delete Mismatch and Fallthrough statistics 3771e37 WriteBatch support for range deletion 236756f Make SyncPoint return immediately when disabled 64a0082 Fix DBSSTest::AddExternalSstFileSkipSnapshot valgrind fail dd7a748 Fix java build 4fe12ba Make db_bench less space for --stats_per_interval 6525ce4 Compaction stats printing: "batch" => "commit group" a117891 Fixed typo (#1279) b248e98 Fix a destruction order issue in ThreadStatusUpdater deda159 Added min/max/avg data block size output to sst_dump e408e98 add Name() to Cache a297643 Fix valgrind memory leak d11c09d Eliminate memcpy from ForwardIterator d367555 Added further Java API options for controlling concurrent writes ebdfe34 Exposed further Java API options for controlling compaction d1be594 Improve documentation of SliceTransform. 6056d63 Improve comment and bug fix for GetOptionsFromMap functions in convenience.h 76a67cf support stackableDB as the baseDB of transactionDB 67c1ae8 Travis build break fix b693ba6 Minor PinnedIteratorsManager Refactoring db3dfb1 Fixes for arcanist config (#1271) 87c91bd Persistent Read Cache (8) Benchmark tooling 2914de6 add sim_cache stats to Statistics 8b79422 [Proof-Of-Concept] RocksDB Blob Storage with a blob log file. 4beffe0 Fix test data race in two FaultInjectionTest tests 821bcb0 util/arena.cc: FreeBSD: More portable use of mmap(MAP_ANON) (#1254) 5370f44 Increase RocksDB version 56dd034 read_options.background_purge_on_iterator_cleanup to cover forward iterator and log file closing too. ccecf3f UniversalCompaction should ignore sorted runs being compacted (when compacting for file num) 1b0069c Remove non-gtest from parallelized tests 638c49f Change HISTORY.md for release 4.11 6b8e9c6 fix vs generator (#1269) c38b075 Update HISTORY.md 8f399e3 Update HISTORY.md 98d0b78 Added check_snapshot option in the DB's AddFile function (#1261) 9fd68b7 set travis open file descriptor limit 59ddb50 Fix travis build break f4d9863 Added SetOptions support to RocksJava (#1243) 7882cb9 Make DBOptionsTest::EnableAutoCompactionAndTriggerStall less falky 44f5cc5 Add time series database (resubmitted) 7c4615c A utility function to help users migrate DB after options change 5bb0a7f Update appveyor.yml 86396cc Update appveyor.yml c1db098 Update appveyor.yml 7da2eaf Update appveyor.yml 34723b4 Cleanup unused variable pending_fsync_. 7cc0dbd cat all logs in sandcastle output 9253767 Correct geHistogramData() -> getHistogramData() (#1257) f35b16f db_bench add an option of --base_background_compactions c3a4bea Fix flaky test `ObsoleteFiles` 8234faa Fix failed test 4990c0d Remove deprecated LEVELDB_PLATFORM_POSIX 7323e4c Fix clang on macOS ee027fc Ignore write stall triggers when auto-compaction is disabled e4609a7 Fix Windows build issues (#1253) 2306167 Fix clang build failure and refactor unit test 343304e Use StopWatch to do statistic job in db_impl_add_file.cc cdc4eb6 Add a GetComparator() function to the ColumnFamilyHandle base class so that the user's comparator can be retrieved. 712dd27 Build break fixes 0155c73 Fix parallel tests `make check -j` c49ea68 Fix to enable running CI jobs locally 726c2f7 Build break fix d51dc96 Experiments on column-aware encodings c116b47 Persistent Read Cache (part 6) Block Cache Tier Implementation 64046e5 Write a benchmark to emulate time series data REVERT: 9808491 Release 4.11.2 REVERT: fbd1c98 Fix recovery for WALs without data for all CFs REVERT: c743289 Fix GetSortedWalFiles when log recycling enabled REVERT: 2be165b Fix a crash when compaction fails to open a file REVERT: 0f4c98d Increase version to 4.11.1 REVERT: c75f4fa fix data race in NewIndexIterator() in block_based_table_reader.cc REVERT: 56f497b Mitigate regression bug of options.max_successive_merges hit during DB Recovery REVERT: 051c88d Compaction stats printing: "batch" => "commit group" REVERT: 071893e Fix a destruction order issue in ThreadStatusUpdater REVERT: 7d7234a Change HISTORY.md for release 4.11 REVERT: d641bb8 read_options.background_purge_on_iterator_cleanup to cover forward iterator and log file closing too. REVERT: e98b76d A utility function to help users migrate DB after options change REVERT: 4001e79 Ignore write stall triggers when auto-compaction is disabled git-subtree-dir: rocksdb-sys/rocksdb git-subtree-split: fea6fdd6764a06a873cd0d6a632cf27ca8820100
e52d6ad bump version to 5.2.1 25ea289 Reset DBIter::saved_key_ with proper user key anywhere before pass to DBIter::FindNextUserEntry 4dd267d Make compaction_pri settable through option string 32be357 Update HISTORY.md for the Direct I/O fixes. 3eb6956 add use_direct_io() to ReadaheadRandomAccessFile 18ba3e2 truncate patch 1c91104 posix writablefile truncate e47027d alignment is on in ReadaheadRandomAccessFile::Read() e5fd8bd Update version number and HISTORY.md ac2a77a Announce the experimetnal two-level index feature in HISTORY.md c4a37dc Print the missed last layer in cfstats a12818a Blog post for 5.1.2 release 3b4ac80 Clarify ldb column family argument d70ce7e Move db_bench flags out of unnamed namespace 186c7ee Remove incorrect statistics warning 53bb015 [rocksdb][PR] compaction_style and compaction_pri should output their value as a st… 69d5262 Two-level Indexes 0a4cdde Windows thread 1aaa898 Adding GetApproximateMemTableStats method 9fc23c5 Use gcc-4.9-glibc-2.20-fb python in precommit_checker b797e42 Dump compression dictionary meta-block 036d668 Fix wrong result in data race case related to Get() 574b543 Rename merger.h -> merging_iterator.h add8b50 Move ThreadLocal implementation into .cc 71d2496 Fix arc setting for Facebook internal tools f289d9f Fix OSX build break after the fallocate change 4a3e7d3 Change the default of delayed slowdown value to 16MB/s 0513e21 RangeSync() should work with ROCKSDB_FALLOCATE_PRESENT not set 8b369ae Cleaner default options using C++11 in-class init ec79a7b Dedup code in option.cc and db_options.cc b96372d improving the C wrapper 04c4ec4 Change corruption_test to use 4 bits. 2d75cd4 NewLRUCache() to pick number of shard bits based on capacity if not given f25f1ec Add test DBTest2.GetRaceFlush which can expose a data race bug 37d4a79 Deserialize custom Statistics object in db_bench 3b35134 Avoid cache lookups for range deletion meta-block 94a0c32 Fix LRU Ref() for handles with external references only 17c1180 Generalize Env registration framework 07dddd5 EnvPosixTestWithParam should wait for all threads to finish 5dad9d6 Avoid logs_ operation out of DB mutex a7b1391 Fix CompactFiles() bug when used with CompactionFilter using SuperVersion 616a146 Fix DeleteRange including sentinels in output files c918c4b Update USERS.md add user Pika 03ca2ac Remove function from DBImpl that are not used anywhere b0029bc Test merge op covered by range deletion in memtable d438e1e Test range deletion block outlives table reader fba726e Version librocksdb.so 9da4d54 Range deletions unsupported in tailing iterator f2b4939 fixed typo 973f1b7 memtable: delete merge value for range deleteion aebfd17 fix non-portable behavior in encoder 753ff84 Fix get approx size d7ea44f Fixup a couple of builds errors on Linux. 537da37 c: allow set savepoint to writebatch af6ec4d fix batchresult handle leak e29bb93 Zlib 1.2.8 is no longer available, switched to 1.2.10 5ac9731 Fix std::out_of_range when DBOptions::keep_log_file_num is zero 4e35ffd cmake: check -momit-leaf-frame-pointer before using it 3c0852d Make ingest external file backward compatible 0e8dfd6 Fix OptimizeForPointLookup() e840213 Change DB::GetApproximateSizes for more flexibility needed for MyRocks 9239103 Flush job should release reference current version if sync log failed da54d36 Disable IngestExternalFile in ReadOnly mode 5cf176c Fix for 2PC causing WAL to grow too large 4a73bb0 Split travis jobs c70d3c7 Enable DBTest.GroupCommit as it runs in a reasonlable time now. 602c13a Remove fadvise with direct IO read f9d18e2 Fix DeleteRange file boundary correctness issue with max_compaction_bytes 3ce091f Add KEEP_DB env var option 77b4806 Fix 2PC with concurrent memtable insert e8a0960 util/thread_local.h: silence a clang-build warning 324a0f9 Follow up for DirectIO refactor bc5d7b7 travis: For linux, do all tests under gcc 3e6899d change UseDirectIO() to use_direct_io() d4e07a8 fix warning of unused direct io helper functions dc2584e direct reads refactor d18dd2c Abort compactions more reliably when closing DB 62384eb Guarding extra fallocate call with TRAVIS because its not working pro… 9f24629 Performance: Iterate vector by reference fe395fb Allow incrementing refcount on cache handles 2172b66 Fix build on FreeBSD 3c233ca Fix Windows environment issues 7631734 Fix the error in ColumnFamiliesTest 7a02ad0 Update travis to ubuntu trusty 60c509f Fix valgrind failure in test CurrentFileModifiedWhileCheckpointing2PC d0ba8ec Revert "PinnableSlice" 54d94e9 PinnableSlice e04480f Fix MS warnings. Use ROCKSDB_Prsz for size_t. c081f72 5.0.1 release blog post ac73d75 Add GetSupportedCompressions() convenience function b104b87 Maintain position in range deletions map 640d724 Update db_bench and sst_dump to test with block cache mid-point inser? 653ac1f C API: support total_order_mode 85ac1a3 Fix rocksdb::Status::getState 76711b6 Make ExternalSSTFileTest::CompactionDeadlock more deterministic c963460 Fix tests under GCC_481 33c86d6 Fix backupable db test e425ec1 utilities/backupable: backup should limit the copy size of wal. 0712d54 Delegate Cleanables d58ef52 Allow SstFileWriter to Fadvise the file away from page cache 17a4b75 Always fsync the file after file copying 2fb70dc examples: Add options_file_example to target all a738af8 db/pinned_iterators_manager.h: bugfix 906523d Add description to the 2PC checkpooint bug in HISTORY.md 438f22b Fix bug of Checkpoint loses recent transactions with 2PC 335981d Fix the directory path for RocksDB repo 548b628 Enable conditionally using adaptive mutexes 4e07b08 include/rocksdb/utilities/env_librados: fix typo ab48c16 Print cache options to info log 972f96b direct io write support 989e644 Remove sst_file_manager option from LITE 1beef65 Fix c_test 3d69282 persistent_cache: fix two timer 046099c The array is malloced by backtrace_symbols(), and must be freed 6ff2c8d Remove gflags as travis build dependency 3cd9ed1 Show sandcastle URL in phabricator 50e305d Collapse range deletions 5d1457d Dump persistent cache options 7bd725e db_bench: introduce --benchmark_read_rate_limit 2966918 Update Netflix section of USERS.md 342370f Simplify MemTable::Update 1a136c1 Expose file size fbff462 Reduce compaction iterator status checks bd6cf7b WritableFileWriter: default buffer size equal min(64k,options.writabl? fc0c6fd "make format" format diff since last commit from master 816c1e3 gcc-7 requires include <functional> for std::function c270735 Iterator should be in corrupted status if merge operator return false a8bf4d6 Make format shows wrong curl command for retrieving clang-format-diff.py 8f5d24a C API: support get usage and pinned_usage for cache 0ab6fc1 Gcc-7 buffer size insufficient b7239bf Gcc 7 fallthrough 477b6ea std::remove_if requires <algorithm> 83f9a6f Fail BackupEngine::Open upon meta-file read error a79eae4 Add pcache documentation images d71e728 Print user collected properties in sst_dump 7004a6f Add missing copyright header 3cdfaec Fixes for MSVC compilation e097222 util/logging.cc: buffer of insufficient size (gcc-7 -Werror=format-length) cfc34d7 Missing break in case in DBTestBase::CurrentOptions bfbcec2 Gcc 7 error expansion to defined 6653e32 build: make it easier to pass PORTABLE 67adc93 intentional fallthough (prevents gcc-7/clang-4 error) 1a146f8 break Flush wait for dropped CF c3e5ee7 util/histogram.cc: HistogramStat::toString buffer insufficient 5334d8b table/block_based_table_builder.cc: intentional fallthrough - comment to match gcc pattern 36d42e6 Disable test to unblock travis build b57dd92 C API: support writebatch delete range 2ba59b5 Disallow ingesting files into dropped CFs 1f6f7e3 cast to signed char in ldb_cmd_test for ppc64le 243975d More accurate error status for BackupEngine::Open f0c509e Return finer-granularity status from Env::GetChildren* dc64f46 Add db_bench option for stderr logging 2cabdb8 Increase buffer size 4a17b47 Remove unnecessary header include 8c2b921 Fixed a crash in debug build in flush_job.cc 20ce081 Fix issue where IngestExternalFile insert blocks in block cache with g_seqno=0 5241e0d fix db_bench argument type c04f6a0 Specify shell in makefile 45c7ce1 CompactRangeOptions C API 2c2ba68 db_stress support for range deletions b821984 DeleteRange read path end-to-end tests 2f4fc53 Compaction::IsTrivialMove relaxing 1dce75b Update USERS.md 304b3c7 Update USERS.md fa50fff Option to expand range tombstones in db_bench c26a4d8 Fix compile error in trasaction_lock_mgr.cc ed8fbdb Add EventListener::OnExternalFileIngested() event 2005c88 Implement non-exclusive locks 0b0f235 Mention IngestExternalFile changes in HISTORY.md 23db48e Update HISTORY.md for 5.0 branch beb36d9 Fixed CompactionFilter::Decision::kRemoveAndSkipUntil 67f37cf Allow user to specify a CF for SST files generated by SstFileWriter 9053fe2 Made delete_obsolete_files_period_micros option dynamic edde954 fix clang build 56281f3 Add memtable_insert_with_hint_prefix_size option to db_bench 4a21b14 Cache heap::downheap() root comparison (optimize heap cmp call) e39d080 Fix travis (compile for clang < 3.9) 3f407b0 Kill flashcache code in RocksDB b77007d Bug: paralle_group status updated in WriteThread::CompleteParallelWorker 247d097 Support for range skips in compaction filter 96fcefb c api: expose option for dynamic level size target 00197cf Add C API to set base_backgroud_compactions 5b219ec deleterange end-to-end test improvements for lite/robustness aad1191 pass rocksdb oncall to mysql_mtr_filter otherwise tasks get created w… e333528 DeleteRange write path end-to-end tests 7784980 Fix mis-reporting of compaction read bytes to the base level 3c6b49e Fix implicit conversion between int64_t to int b3b8756 Remove unused assignment in db/db_iter.cc 4f6e89b Fix range deletion covering key in same SST file a2bf265 Avoid intentional overflow in GetL0ThresholdSpeedupCompaction 52fd1ff disable UBSAN for functions with intentional -ve shift / overflow 1886c43 Fix CompactionJob::Install division by zero 63c30de fix options_test ubsan 13e66a8 Fix compaction_job.cc division by zero 01eabf7 Fix double-counted deletion stat 7ffb10f DeleteRange compaction statistics 236d4c6 Less linear search in DBIter::Seek() when keys are overwritten a lot cd7c414 Improve Write Stalling System dfb6fe6 Unified InlineSkipList::Insert algorithm with hinting 3068870 Making persistent cache more resilient to filesystem failures 734e4ac Eliminate redundant cache lookup with range deletion 182b940 Add WriteOptions.no_slowdown 4118e13 Persistent Cache: Expose stats to user via public API f2a8f92 rocks_lua_compaction_filter: add unused attribute to a variable 4444256 Remove use of deprecated LZ4 function 548d7fb Fix fd leak when using direct IOs fd43ee0 Range deletion microoptimizations 23a18ca Reword support a little bit to more clear and concise 481856a Update support to separate code issues with general questions a0deec9 Fix deadlock when calling getMergedHistogram fe349db Remove Arena in RangeDelAggregator e63350e Use more efficient hash map for deadlock detection a13bde3 Skip ldb test in Travis 73843aa Direct I/O Reads Handle the last sector correctly. 9d60151 Implement PositionedAppend for PosixWritableFile 3f62215 Lazily initialize RangeDelAggregator's map and pinning manager 41e77b8 cmake: s/STEQUAL/STREQUAL/ c1038d2 Release RocksDB 5.0 635a7bd refactor TableCache Get/NewIterator for single exit points f39452e Fix heap use after free ASAN/Valgrind a4eb738 Allow plain table to store index on file with bloom filter disabled 36e4762 Remove Ticker::SEQUENCE_NUMBER 86eb2b9 Fix src.mk 0765bab Remove LATEST_BACKUP file 647eafd Introduce Lua Extension: RocksLuaCompactionFilter 760ef68 fix deleterange asan issue 327085b fix valgrind 715591b Ask travis to use JDK 7 972e3ff Enable allow_concurrent_memtable_write and enable_write_thread_adaptive_yield by default 420bdb4 option_change_migration_test: force full compaction when needed 1543d5d Report memory usage by memtable insert hints map. 018bb2e DeleteRange support for db_bench dc51bd7 CMakeLists.txt: FreeBSD has jemalloc as default malloc 48e8bae Decouple data iterator and range deletion iterator in TableCache 4b0aa3c Fix failed compaction_filter_example and add it into make all 53b693f ldb support for range delete 661e4c9 DeleteRange unsupported in non-block-based tables 489d142 DeleteRange interface eba99c2 Fix min_write_buffer_number_to_merge = 0 bug 2ef92fe Remove all instances of relative_url until GitHub pages problem is fixed. 91300d0 Dynamic max_total_wal_size option ec2f647 Consider subcompaction boundaries when updating file boundaries for range deletion 800e515 Fix CSS issues again b952c89 Parallize persistent_cache_test and transaction_test 3b192f6 Handle full final subcompaction output file with range deletions 6c57952 Make range deletion inclusive-exclusive 425210c CSS issues are arising on the Github Pages side. Temp fix. 1ea79a7 Optimize sequential insert into memtable - Part 1: Interface df5eeb8 Optimize sequential insert into memtable - Part 2: Implementation 5ed6508 Fix SstFileWriter destructor adb665e Allowed delayed_write_rate option to be dynamically set. 307a4e8 sst_dump support for range deletion 361010d Exporting compaction stats in the form of a map 672300f Use relative Urls for stylesheets b39b2ee do not call get() in recovery mode 1ca5f6d Fix 2PC Recovery SeqId Miscount e095d0c Rocksdb contruns to new Sandcastle API 14c0380 Convenience option to parse an internal key on command line c90fef8 fix open failure with empty wal 4e20c5d Store internal keys in TombstoneMap a9fb346 Fix RocksDB Lite build failure in c_test.cc d133b08 Use correct sequence number when creating memtable 144cdb8 16384 as e.g .value for compression_max_dict_bytes 9bd191d Fix deadlock between (WriterThread/Compaction/IngestExternalFile) a9fae0a CSS problems again :( 193221e Fix Forward Iterator Seek()/SeekToFirst() e48f3f8 remove tabs and duplicate #include in c api 85bd8f5 Minor fix to GFLAGS usage in persistent cache a787527 c: support seek_for_prev 0f17f92 Make the header links a bit more flexible cf19f55 single quotes in feed 2dc019e Fix header links f1aedda More Jekyll 3.3 fixes c54cdc3 More Jekyll 3.3 updates 2bcaf82 Update product and feature template for Jekyll 3.3 24bceb0 Java API - Implement GetFromBatch and GetFromBatchAndDB in WBWI 815f54a Insert range deletion meta-block into block cache 9e7cf34 DeleteRange user iterator support 5c5d01a Fix wrong comment (Maximum supported block size) f998c97 DeleteRange Get support 879f366 Add C api for RateLimiter 557034f Remove all instances of baseurl 437942e Add avoid_flush_during_shutdown DB option 2b16d66 Change max_bytes_for_level_multiplier to double 16fb044 expose IngestExternalFile to c abi ce22ea9 Fix casts for MSVC 196af03 Introduce FAIL_ON_WARNINGS CMake variable (default ON) 40a2e40 DeleteRange flush support d5555d9 Fix MSVC compile error in 32 bit compilation da61f34 Print compression and Fast CRC support info as Header level f9eb567 db_bench: --dump_malloc_stats takes no effect 6a4faee fix freebsd build include path err and so & jar file name c90c48d Show More DB Stats in info logs 1b295ac DBTest.GetThreadStatus: Wait for test results for longer 25f5742 Update documentation to point at gcc 4.8 b50a81a Add a test for tailing_iterator 04751d5 L0 compression should follow options.compression_per_level if not empty 2946cad Improve RangeDelAggregator documentation 0a9fd05 Update Vagrant file (test internal phabricator workflow) fcd1e0b Make rocksdb work with internal repo 0aab5e5 FreeBSD: malloc_usable_size is in <malloc_np.h> (#1428) 9c0bb7f cmake: drop "-march=native" from CXX_FLAGS (#1429) eeb27e1 Add handy option to turn on direct I/O in db_bench (#1424) c6168d1 removed some declarations from c.h which resulted in undefined symbols (#1407) bc429de revert fractional cascading in farward iterator b9bc7a2 Use skiplist rep for range tombstone memtable 60a2bbb Makefile: generate util/build_version.cc from .in file (#1384) 9ee8406 Disable DBTest.RepeatedWritesToSameKey (#1420) f41df30 OptionChangeMigration() to support FIFO compaction 2e8004e Changing the legocastle run to use valgrind_test instead of _check 9de2f75 revert Prev() in MergingIterator to use previous code in non-prefix-seek mode 2449518 DBSSTTest.RateLimitedDelete: not to use real clock 1168cb8 Fix a bug that may cause a deleted row to appear again 99c052a Fix integer overflow in GetL0ThresholdSpeedupCompaction (#1378) f83cd64 Fix a bug that mistakenly disable regression_test.sh to update commit (#1415) 0e926b8 Passing DISABLE_JEMALLOC=1 to valgrind_check if run locally 4dfaa66 Make IsDeadlockDetect() virtual member of Transaction 59a7c03 Change ioptions to store user_comparator, fix bug 869ae5d Support IngestExternalFile (remove AddFile restrictions) 1d9dbef Restrict running condition of UniversalCompactionTrivialMoveTest2 4edd39f Implement deadlock detection 48fd619 Minor fixes to RocksJava Native Library initialization (#1287) 48e4e84 Disable auto compactions in memory_test and re-enable the test (#1408) fb2e412 column_family_test: disable some tests in LITE 5af651d fix data race in compact_files_test a0ba0aa Fix uninitialized variable gcc error for MyRocks b88f8e8 Support SST files with Global sequence numbers [reland] 08616b4 [db_bench] add filldeterministic (Universal+level compaction) 52c9808 not split file in compaciton on level 0 5e0d6b4 fix db_stress assertion failure ab53998 Bump RocksDB version to 4.13 (#1405) b4d0712 SamePrefixTest.InDomainTest to clear the test directory before testing aa09d03 Avoid calling GetDBOptions() inside GetFromBatchAndDB() 6fbe96b Compaction Support for Range Deletion 257de78 Remove "-Xcheck:jni" from Java tests (#1402) d88dff4 add seeforprev in history 5027dd1 Fix a minor bug in the ldb tool that was not selecting the specified (#1399) fea6fdd Fix @see in two Java functions (#1396) b1031d6 Remove function local statics that interfere with memory pooling (#1392) f470540 Handle WAL deletion when using avoid_flush_during_recovery e29d3b6 Make max_background_compactions and base_background_compactions dynamic changeable 21e8dac fix assertion failure in Prev() b9311aa Implement WinRandomRW file and improve code reuse (#1388) a249a0b check_format_compatible.sh to use some branch which allows to run with GCC 4.8 (#1393) 040328a Remove an assertion for single-delete in MergeHelper::MergeUntil 8cbe3e1 Relax the acceptable bias RateLimiterTest::Rate test be 25% f26a139 Log successful AddFile 5691a1d Fix compaction conflict with running compaction 017de66 fixup commit 1b7af5f Redo handling of recycled logs in full purge 27bfe32 Editorial change to README.md 89cc404 A bit of doc restructuring 9e7fda8 Fix arcanist 2e4b5ca Add missing RateLimiter class to the Windows build (#1382) ce4963f [doc] Document that Visual Studio 2015+ is now required for Windows builds (#1389) e489270 Fix scoped arena iterator (#1387) f8d8cf5 Fix log_write_bench -bytes_per_sync option. (#1375) 02b3e39 Make txn->GetState() const 447f171 new Prev() prefix support using SeekForPrev() 991b585 More block cache tickers d6ae6de Add Statistics::getAndResetTickerCount(). aea3ce4 Avoid string CONCAT which is not supported in cmake 2.6 (#1383) 2ad68b9 Support running consistency checks in release mode 67501cf Fix -ve std::string::resize 04b02dd Testing asset links after config change 8c55bb8 Make Lock Info test multiple column families d062328 Revert "Support SST files with Global sequence numbers" 5cd2883 [RocksJava] Adjusted RateLimiter to 3.10.0 (#1368) 37737c3 Expose Transaction State Publicly 2c1f952 Add facility to write only a portion of WriteBatch to WAL 043cb62 Fix record_size in log_write_bench, swap args to std::string::assign. (#1373) 4985f60 env_mirror: fix a few leaks (#1363) 5aded67 update of c.h (#1371) 912aec1 "Recent Posts" -> "All Posts" 7cbb298 Make sure that when contribtuing we call out creating appropriate directories a06ad47 Add top level doc information to CONTRIBUTING.md 3fdd5b9 A little more generic CONTRIBUTING.md ed4fc31 Add link to CONTRIBUTING.md to main docs README.md e4922e1 Forgot to truncate one blog post 6d8cd7e Add CONTRIBUTING.md for rocksdb.org contribution guidance bd55e5a Fix some formatting of compaction blog post 0f60358 CRLF -> LF mod (including removing trailing whitespace for those files) b90e29c Truncate posts on the main /blog/ page 0d7acad Add author fields to blog posts 01be441 Add GitHub link to the landing page header 9d6c961 Fix Mac build ab01da5 Support SST files with Global sequence numbers d346ba2 Minor fixes around Windows 64 Java Artifacts (#1366) e91b4d0 Add factory method for creating persistent cache that is accessible from public be1f109 Expose transaction id, lock state information and transaction wait information 6009c47 Store range tombstones in memtable 3c21c64 Use size hint for HashMap in multiGet. Similar to https://github.com/facebook/rocksdb/pull/1344 (#1367) 13f7a01 Fixing JNI release build for gcc (#975) 7260662 Add Java API for SstFileWriter 2638824 delete unused variable for PrevInterval() 87dfc1d Fix conflict between AddFile() and CompactRange() eb44ed6 Update 2016-09-28-rocksdb-4-11-2-released.markdown e443761 Update 2016-09-28-rocksdb-4-11-2-released.markdown 501f051 Update 2016-09-28-rocksdb-4-11-2-released.markdown dec9009 Update 2016-09-28-rocksdb-4-11-2-released.markdown 4ed69dd Create 2016-09-28-rocksdb-4-11-2-released.markdown 21f4bb5 cmake support for linux and osx (#1358) 4defe30 fix typo in comments (#1360) f517d9d Add SeekForPrev() to Iterator eb3894c Recompute compaction score on SetOptions (#1346) 5c64fb6 Fix AddFile() conflict with compaction output [WaitForAddFile()] 9e9f5a0 Fix CompactFilesTest.ObsoleteFiles timeout (#1353) c2a62a4 not cut compaction output when compact to level 0 9ed928e Split DBOptions into ImmutableDBOptions and MutableDBOptions 4bc8c88 Recover same sequence id from WAL (#1350) 0a1bd9c add cfh deletion started listener da5a9a6 Fix mac build d45eb6c Fix typo (#1349) abc0ae4 Add AddFile() InternalStats for Total files/L0 files/total keys ingested 7152563 forbid merge during recovery 5735b3d Fix compiling under -Werror=missing-field-initializers 654ed9a loose the assertion condition of rate_limiter_test e4d3f5d Fix DBImpl::GetWalPreallocateBlockSize Mac build error 7afbb74 solve the problem of table_factory_to_write_=nullptr (#1342) d78a440 DBImpl::GetWalPreallocateBlockSize() should return size_t 42ac9c5 Retry getting arcanist token on failure b666f85 Consider more factors when determining preallocation size of WAL files 4c3f449 Add TableBuilderOptions::level and relevant changes (#1335) 3edb946 Avoid hard-coded sleep in EnvPosixTestWithParam.TwoPools 0a88f38 Remove ColumnFamilyData::options() 41a9070 Fix java makefile dependencies 8d9bf5c Fix DBOptionsTest.GetLatestOptions 40cfa3e Fix DBWALTest.RecoveryWithLogDataForSomeCFs with mac 06b4785 Fix recovery for WALs without data for all CFs d7242ff Fix GetSortedWalFiles when log recycling enabled 17f76fc DB::GetOptions() reflect dynamic changed options 215d128 Fix typo (#903) a958c26 Rename jvalue to jval in rocksjni 0a165bd Have Facebook link point to RocksDB on FB 3639f32 Fix bug in UnScSigned-off-by: xh931076284 <931076284@qq.com> (#1336) 8e061f9 Refactor GetMutableOptionsFromStrings 81747f1 Refactor MutableCFOptions ba65c81 Support POSIX RandomRWFile 1d980a8 Create CNAME 2adab1d Add API links to the header bar a182b29 Preserve blog comments in markdown f54de92 Adding Dgraph to list of Users (#1291) 9e4aa79 Summary: (#1313) a10e8a0 Fix C api memtable rep bugs. (#1328) eb1d4d5 Release RocksDB 4.12 22d88e2 Allow an offset as well as a length to be specified for byte[] operations in RocksJava JNI (#1264) b06b191 add C api for set wal_recovery_mode (#1327) 1cca091 Temporarily revert Prev() prefix support de28a25 Update HISTORY.md for thread-local stats 0fcb6db Remove extraneous function prototypes from c.h (#1326) 52ee07b Move AddFile() tests to external_sst_file_test.cc 66a91e2 Add NoSpace subcode to IOError (#1320) 67036c0 Fix Flaky ColumnFamilyTest.FlushCloseWALFiles 0e2da49 fix typo in option.h's comment (#1321) 6d61358 Add real Google Analytics ID 2d9d36e Have "Edit on GitHub" point to master instead of gh-pages 9377518 Update landing page content 1ec75ee Add redirects from old blog posts link to new format 607628d Support ZSTD with finalized format ce1be2c Fix build error on Windows (AppVeyor) (#1315) f7669b4 Fix Windows Build 22696b0 Fix uninitlized CompactionJob::SubcompactionState::current_output_file_size c1865e0 Trigger more tests per diff a88677d Remove ImmutableCFOptions from public API 80c7559 Fix data race in AddFile() with multiple files + custom comparator bug 5051755 Fix db_bench memory use after free (detected by clang_analyze) 4fd08f4 Ensure Correct Behavior of StatsLevel kExceptDetailedTimers and kExceptTimeForMutex (#1308) e14fbaa Add FAQ based on the front page of the current rocksdb.org 3c22624 Migrate the RocksDB Worpdress blog over to Jekyll ee0e220 Transfer the current Getting Started contents to GitHub Pages 5a0e9a4 Initial Landing Page 9447a85 Remove the `doc` directory 3214905 Merge options source_compaction_factor, max_grandparent_overlap_bytes and expanded_compaction_factor into max_compaction_bytes 4590b53 add stats to Cache::LookUp() 85bb308 Expose Utility function StringToMap() (#1306) 8ce1b84 Fix Travis on Mac 380e651 Fix Mac build failure (#1309) 1613fa9 Thread-specific histogram statistics 6a14d55 add prefix_seek_mode to db_iter_test de47e2b Fix ClockCache memory leak f099af4 Fix travis db74b1a fix bug in merge_iterator when data race happens b18f9c9 add nullptr check to internal_prefix_transform 4e395e8 Update docs README.md 2482d5f support Prev() in prefix seek mode 7541c7a Fix cache_test valgrind_check failure c8513cd Update the download location of Snappy (#1304) b49b92c Introduce Read amplification bitmap (read amp statistics) c700484 store prefix_extractor_name in table 4ad928e add comment to SimCache to estimate actual capacity e9b2af8 Expose ThreadPool under include/rocksdb/threadpool.h 23a0570 Document memtable flush behavior in CancelAllBackgroundWork() dade61a Mitigate regression bug of options.max_successive_merges hit during DB Recovery cce702a [db_bench] Support single benchmark arguments (Repeat for X times, Warm up for X times), Support CombinedStats (AVG / MEDIAN) 3586901 cat tests logs sorted by exit code b2ce595 Persist data during user initiated shutdown 4b3438d Fix parallel valgrind (valgrind_check) a081f79 Relax consistency for thread-local ticker stats b10d65c Update and slightly clarify instructions in build_detect_platform (#1301) f85f99b Fix the Windows build of RocksDB Java. Similar to https://github.com/facebook/rocksdb/issues/1220 (#1284) 7b81095 Fix a crash when compaction fails to open a file 7c95868 Thread-specific ticker statistics ea9e075 Add initial GitHub pages infra for RocksDB documentation move and update. (#1294) 2a9c971 [Flaky Test] Disable DBPropertiesTest.GetProperty d76ddf3 Disable ClockCache db_crashtest cec2c64 fix data race in NewIndexIterator() in block_based_table_reader.cc badbff6 Not insert into block cache if cache is full and not holding handle 4a16c32 Option to cache index/filter blocks with priority 99c4af7 Make ClockCache available with TSAN build f57bc1d Fix lambda expression for clang/windows 5440675 Fix lambda capture expression for windows 6584cec Fold function for thread-local data 817eeb2 Add singleDelete to RocksJava (#1275) ffdf6ee Add Status to RocksDBException so that meaningful function result Status from the C++ API isn't lost (#1273) ecf9003 Fix bug in printing values for block-based table 72f8cc7 LRU cache mid-point insertion 6a17b07 Add TablePropertiesCollector support in SstFileWriter 78837f5 TableBuilder / TableReader support for range deletion 4cc37f5 Introduce ClockCache ff17a2a Adding TBB as dependency. 49d88be c abi: allow compaction filter ignore snapshot (#1268) 0b63f51 fixes 1215: execute_process(COMMAND mkdir ${DIR}) fails to create a directory with cmake on Windows (#1219) 3981345 Small nits (#1280) 2a2ebb6 Move LRUCache structs to lru_cache.h header 2fc2fd9 Single Delete Mismatch and Fallthrough statistics 3771e37 WriteBatch support for range deletion 236756f Make SyncPoint return immediately when disabled 64a0082 Fix DBSSTest::AddExternalSstFileSkipSnapshot valgrind fail dd7a748 Fix java build 4fe12ba Make db_bench less space for --stats_per_interval 6525ce4 Compaction stats printing: "batch" => "commit group" a117891 Fixed typo (#1279) b248e98 Fix a destruction order issue in ThreadStatusUpdater deda159 Added min/max/avg data block size output to sst_dump e408e98 add Name() to Cache a297643 Fix valgrind memory leak d11c09d Eliminate memcpy from ForwardIterator d367555 Added further Java API options for controlling concurrent writes ebdfe34 Exposed further Java API options for controlling compaction d1be594 Improve documentation of SliceTransform. 6056d63 Improve comment and bug fix for GetOptionsFromMap functions in convenience.h 76a67cf support stackableDB as the baseDB of transactionDB 67c1ae8 Travis build break fix b693ba6 Minor PinnedIteratorsManager Refactoring db3dfb1 Fixes for arcanist config (#1271) 87c91bd Persistent Read Cache (8) Benchmark tooling 2914de6 add sim_cache stats to Statistics 8b79422 [Proof-Of-Concept] RocksDB Blob Storage with a blob log file. 4beffe0 Fix test data race in two FaultInjectionTest tests 821bcb0 util/arena.cc: FreeBSD: More portable use of mmap(MAP_ANON) (#1254) 5370f44 Increase RocksDB version 56dd034 read_options.background_purge_on_iterator_cleanup to cover forward iterator and log file closing too. ccecf3f UniversalCompaction should ignore sorted runs being compacted (when compacting for file num) 1b0069c Remove non-gtest from parallelized tests 638c49f Change HISTORY.md for release 4.11 6b8e9c6 fix vs generator (#1269) c38b075 Update HISTORY.md 8f399e3 Update HISTORY.md 98d0b78 Added check_snapshot option in the DB's AddFile function (#1261) 9fd68b7 set travis open file descriptor limit 59ddb50 Fix travis build break f4d9863 Added SetOptions support to RocksJava (#1243) 7882cb9 Make DBOptionsTest::EnableAutoCompactionAndTriggerStall less falky 44f5cc5 Add time series database (resubmitted) 7c4615c A utility function to help users migrate DB after options change 5bb0a7f Update appveyor.yml 86396cc Update appveyor.yml c1db098 Update appveyor.yml 7da2eaf Update appveyor.yml 34723b4 Cleanup unused variable pending_fsync_. 7cc0dbd cat all logs in sandcastle output 9253767 Correct geHistogramData() -> getHistogramData() (#1257) f35b16f db_bench add an option of --base_background_compactions c3a4bea Fix flaky test `ObsoleteFiles` 8234faa Fix failed test 4990c0d Remove deprecated LEVELDB_PLATFORM_POSIX 7323e4c Fix clang on macOS ee027fc Ignore write stall triggers when auto-compaction is disabled e4609a7 Fix Windows build issues (#1253) 2306167 Fix clang build failure and refactor unit test 343304e Use StopWatch to do statistic job in db_impl_add_file.cc cdc4eb6 Add a GetComparator() function to the ColumnFamilyHandle base class so that the user's comparator can be retrieved. 712dd27 Build break fixes 0155c73 Fix parallel tests `make check -j` c49ea68 Fix to enable running CI jobs locally 726c2f7 Build break fix d51dc96 Experiments on column-aware encodings c116b47 Persistent Read Cache (part 6) Block Cache Tier Implementation 64046e5 Write a benchmark to emulate time series data 9ae92f5 More granular steps in the Makefile, can help with running all or single Java tests (and with ASAN build - https://github.com/facebook/rocksdb/wiki/JNI-Debugging) (#1237) 7c01d65 [Fix Java] Remove duplicate cases in LoggerJniCallback::Logv 8796934 Added missing Java ReadOptions settings (#1109) 5e2c796 Make DBTest.CompressionStatsTest more deterministic 557748f Fix db_stress failure (pass merge_operator even if not used) 811ee21 Bugfix to ensure that logging can be achieved from threads that are not known to the JVM (#1106) afad5bd Simplify thread-local static initialization 6920cde Remove an extra apostrophe e72ea48 add InDomain regression test 9c8ac14 Avoid duplicate task creation for RocksDB contruns d4c4542 db_stress shouldn't assert file size 0 if file creation fails d3bfd33 Testing out parallel sandcastle changes 7efd9c2 Increse timeout in some tests 50b8d29 fixes 1230: Error:string sub-command REGEX, mode REPLACE needs at least 6 arguments total to command (#1231) 5c858dd fix errata in libnuma test (#1244) e5b5f12 Change options memtable_prefix_bloom_huge_page_tlb_size => memtable_huge_page_size and cover huge page to memtable too 0ce258f Compaction picker to expand output level files for keys cross files' boundary too. ac0d93b fixes 1217: rocksdbjni javac and javah execute_processes fail on windows (#1218) 1ae4609 Appveyor badge to show master branch 8745f01 [Fix java build] Stop using non standard std::make_unique e12270d fix previous typo bbd6a5a ldb restore subcommand 9498069 Run error-filtering script on diff-triggered tests f8061a2 Fix Statistics TickersNameMap miss match with Tickers enum 16e225f Fix MergeContext::copied_operands_ strings moving a4955b3 Run sandcastle tests in /dev/shm ae0ad71 Fix flaky DBSSTTEST::DeleteObsoleteFilesPendingOutputs b2a8016 Update db_bench_tool.cc (#1239) c665458 Disable two dynamic options tests under lite build 2a6d0cd Ignore stale logs while restarting DBs ee8bf2e fixes 1228: rockdbjni loadLibraryFromJarToTemp fails when file is already present (#1232) f85df12 Re-enable tsan crash white-box test with reduced killing odds 89e4c48 Update README.md to include appveyor badge b06ca5f ldb load, prefer ifsteam(/dev/stdin) to std::cin (#1207) 4ea0ab3 Revert "Remove bashism from `make check` (#1225)" 12767b3 fixes 1220: rocksjni build fails on Windows due to variable-size array declaration (#1223) a9d512a Update .gitignore for internal release d5a51d4 Need to make sure log file synced before flushing memtable of one column family 89f319c Fix unit test which breaks lite build b506329 Add unit test not on /dev/shm as part of the pre-commit tests b9a9718 Bump next release version 663afef Add EnvLibrados - RocksDB Env of RADOS (#1222) 32604e6 Fix flush not being commit while writing manifest 9ab38c4 Remove %z Format Specifier and Fix Windows Build of sim_cache.cc (#1224) 08ab1d8 Remove bashism from `make check` (#1225) f9b14be Re-enable TSAN crash test but only with black box crash test 68f3eb7 Run release build for CLANG and GCC 4.8.1 in pre-commit tests too e70020e Only cache level 0 indexes and filter when opening table reader 7bedd94 Build break fix 68a8e6b Introduce FullMergeV2 (eliminate memcpy from merge operators) e70ba4e MemTable::PostProcess() can skip updating num_deletes if the delta is 0 2a282e5 DBTablePropertiesTest.GetPropertiesOfTablesInRange: Fix Flaky d9cfaa2 Persistent Read Cache (6) Persistent cache tier implentation - File layout 9430333 New Statistics to track Compression/Decompression (#1197) 515b11f fixes #1210: rocksdb/java/CMakeLists.txt lacks cmake_minimum_required (#1214) 876cb8b fixes #1212: rocksdbjni maven build does not escape slashes in groovy script (#1213) 21c55bd DBTest.DynamicLevelCompressionPerLevel: Tune Threshold 4b95253 Refactor cache.cc c6a8665 Update LANGUAGE-BINDINGS.md 880ee36 ldb backup support 6797e6f Avoid updating memtable allocated bytes if write_buffer_size is not set dda6c72 Add DestroyColumnFamilyHandle(ColumnFamilyHandle**) to db.h 56222f5 Avoid FileMetaData copy 15b7a4a Fixed output size and removed unneeded loop 6ea41f8 Fix deadlock when trying update options when write stalls efd013d Miscellaneous performance improvements e6f68fa Update Makefile to fix dependency 816ae09 fix test failure e295da1 Fix Log() doc for default level 8e6b38d update DB::AddFile to ingest list of sst files 296545a Fix clang analyzer errors 61dbfbb Add release build to RocksDB per-diff/post-commit tests 907f24d Concurrent memtable inserter to update counters and flush state after all inserts 0f691c4 CLI option & Rename() allow overwrite 7c19007 delete unnessary pointer cast in beginInternalTransaction() function e1b3ee8 Cleanup auto-roll logger flush-while-rolling test cd4178a Add a new feature to enforce a sync point only active on a thread b954847 Fix release build for MyRocks by using debug-only code only in debug builds a00bf1b Add More Logging to track total_log_size 01f77cb Update USER.md to include more services at Facebook. eb53c05 Add comment for GetBackupInfo about returned BackupInfos order 32df973 Add options.write_buffer_manager: control total memtable size across DB instances 5aaef91 group multiple batch of flush into one manifest file (one call to LogAndApply) a45ee83 Fix a bug that accesses invalid address in iterator cleanup function 38fae9e fix typos in HISTORY.md (#1192) 1a11c93 Disable some persistent cache tests on linux/clang 9b5adea Add More Logging to track total_log_size 95d96ee remove LockFile ff45d1b if read only backup engine can't find meta dirs, return NotFound() instead of IOError() cb2476a fix rate limiter to avoid starvation 6b71676 Run env_basic_test on Env::Default 9eb0b53 Move env_basic_test cleanup to TearDown 1fe3bf8 Re-enable linux on travis 4369279 Fixed Minor Bug on Windows Build and db_bench_tool.cc (#1189) 95c1924 writable file close before reset 197b832 Update USERS.md bdb1d19 Fix UBSan build break caused by variable not initialized b726bf5 FreeBSD does not have std::to_string (#1190) faa7eb3 Improve regression_test.sh c4cef07 Update DBTestUniversalCompaction.UniversalCompactionSingleSortedRun to use max_size_amplification_percent = 0 892e9d3 make transaction WriteOptions modifiable 4f2b094 fix simple typos (#1183) 3b7ed67 ColumnFamilyOptions API [CF + RepairDB part 3/3] 56ac686 Detect column family from properties [CF + RepairDB part 2/3] 3fc713e delete 2nd level children for default env 343507a Refactor to use VersionSet [CF + RepairDB part 1/3] aa432be Workarounds for continuous build implementation 8cd9f04 Test change to verify new commit detection 8a4ee7e Trivial change to test cont. build af6248d Fix max_bytes_for_level_base comment 0d7b261 add tests to env_basic_test.cc 6576fa0 Fix minor typos and PHP source file name used to trigger the builds c4e19b7 Add a read option to enable background purge when cleaning up iterators fa813f7 Update DB::AddFile() to ingest the file to the lowest possible level d6b79e2 Remove filter_deletes from crash_test a52e4d7 Framework for enabling continuous RocksDB build and tests f9bd667 Makefile warning for invalid paths in make_config.mk 88a2776 Update SstFileWriter to use bottommost_compression if avaliable e87d5df TiKV use-case (#1172) 7b79238 Deprectate filter_deletes 4939fc3 Bulk load mode shouldn't stop ingest 3a2bccc Fixed a crash bug that incorrectly parse deprecated options in options_helper cf8adc9 Allow arcanist_util to work with both new and old arc versions 30a24f2 Add InternalStats and logging for AddFile() d26a848 Temporarily disable travis on linux 249e796 Fix Flaky DBCompactionTest.SkipStatsUpdateTest 162c917 Make sandcastle access secure 8366e10 Fix clang build 0babce5 Move away from enum char value -1 812dbfb Optimize BlockIter::Prev() by caching decoded entries 550bf89 Minor bug fix with log name 886af59 Fix examples/Makefile jemalloc error e3b1e3d Expose save points in Java WriteBatch and WBWI (#1092) f5177c7 Remove wasteful instrumentation in FullMerge (stacked on D59577) 97fd2a6 Remove dead Jenkins code and support `arc diff --preview` in RocksDB 7c919de Reuse TimedFullMerge instead of FullMerge + instrumentation 9a33a72 Remove the comments saying allow_concurrent_memtable_write and enable_write_thread_adaptive_yield are not stable 81f6b33 Fix tsan error bc8af90 add option to not flush memtable on open() 8100ec2 Fix libgcc broken lib path 7360db3 Add a check mode to verify compressed block can be decompressed back 2a79af1 Fix Java Break Related to memtable bloom bits to size ratio change 6faddd7 Merge db/slice.cc into util/slice.cc 5009b53 BlockBasedTable::FullFilterKeyMayMatch() Should skip prefix bloom if full key bloom exists 2d05eae Fix name conflict in delete_shceduler_test and db_sst_test bde7d10 Fix clang_analyze path in fbcode_config.sh ca3db54 Fetch branches from github for format compatibility test 20699df memtable_prefix_bloom_bits -> memtable_prefix_bloom_bits_ratio and deprecate memtable_prefix_bloom_probes e9c1fac Minor fix to precommit-check.py fcc47fa New features to precommit check script 56887f6 Backup Options a683d4a URI-based Env selection for db_bench 53a4bd8 duplicate line 3e86869 release 4.9 update version and history b2973ea Remove options builder 5b197bf Enabled Windows build for volatile tier implementation 281fbdd Temporarily remove PersistentCacheOptions from persistent_cache_tier.h to fix unity build 2ae15b2 Format compatible test should cover forward compatibility up to 4.8. 00a0587 netflix use-case 5091dfc use branch names in format compatibility test edc764e Use valgrind built with gcc-4.9-glibc-2.20 8ff59b2 Disable PersistentCacheTierTest.VolatileCacheInsertWithEviction test under TSAN temporarily 1ba4522 Fix for GCC 5.4 (#1157) 972c895 Previously WARN level logging became FATAL level logging in the Java API (#1089) a73b26f Adding test for contiguous WAL detection 098da83 Fix CLANG build break caused by the recent Persistent Cache change 54db29b Use gvfs links in dependencies.sh d755c62 Persistent Read Cache (5) Volatile cache tier implementation fda0984 Allow regression_test.sh to specify OPTIONS_FILE. Add header comments. 0fee896 Fix Windows build 10d46b9 Update tp2 clang path to fix clang build 774a6aa Java API - Rename geHistogramData -> getHistogramData (#1107) 3070ed9 Persistent Read Cache (4) Interface definitions e42dc91 Update paths for fbcode dependencies 5647fa4 stack_trace,cc: The current Stacktrace code does not compile for FreeBSD (#1153) 0d65ace threadpool.cc: abort() lives in stdlib.h on FreeBSD (#1155) 19dd5a6 env_chroot.cc: FreeBSD likes stdlib.h for realpaht() and friends (#1154) 5aca977 env_basic_test library for testing new Envs [pluggable Env part 3] 1147e5b Adding support for sharing throttler between multiple backup and restores 6e6622a Create env_basic_test [pluggable Env part 2] e532877 Add statistics field to show total size of index and filter blocks in block cache a791a2c Java API - Bugfix for native linking of Compaction Filter (#1099) af0c9ac Env registry for URI-based Env selection [pluggable Env part 1] 02ec815 allow updating block cache capacity from C (#1149) 630b732 fix flaky sim_cache_test 62d5480 Add persistent cache to Windows build system 8429586 Fix race condition in SwitchMemtable 88acd93 Allows db_bench to take an options file 3a276b0 Add a callback for when memtable is moved to immutable (#1137) 8cf0f86 Allow regression test to run db_bench at a remost host 27ad170 Fix Windows build break 936973d Small tweaks to logging to track the number of immutable memtables 21c047a add readahead size option (#1146) 71c7eed Assert boundary checks for SetPerfLevel() 5d85fdb add missing lock c40c4ca LDBCommand::SelectCommand to use a struct as the parameter 590e261 fix delete file bug when do checkpoint (#1138) 8dfa980 Add statically-linked library for tools/benchmarks f62fbd2 Handle overflow case of rate limiter's paramters 57461fb In-memory environment read beyond EOF 0e20000 LDBCommand::InitFromCmdLineArgs() to move from template to function wrapper 472c06e Add low and upper bound values for rocksdb::PerfLevel enum 157e063 MutexLock -> ThreadPoolMutexLock in util/threadpool.cc 23d4cf4 include/rocksdb/sst_file_writer.h should not depend on util/mutable_cf_options.h 345fd73 Fix flaky DBTestDynamicLevel.DynamicLevelMaxBytesBase2 8fc75de Minor fix to disable DynamicLevelMaxBytesBase2 9dd50d9 Fix db_bench 5d66025 add simulator Cache as class SimCache/SimLRUCache(with test) d379d11 Update CMakeLists.txt for added test 21f847e Direct IO fix for Mac 99765ed Clean up the ComputeCompactionScore() API def2f7b Expose report_bg_io_stats option in the C API. (#1131) f89caa1 Direct IO capability for RocksDB 8f12145 C API: Expose DeleteFileInRange (#1132) 11f329b db/db_impl: restrict WALRecoveryMode when using recycled log files 2b2a898 db/log_reader: combine kBadRecord{Len,Checksum} for readability 34df1c9 db/log_reader: treat bad record length or checksum as EOF 7947aba db/log_reader: move kBadRecord{Len,Checksum} handling into ReadRecord 847e471 db/log_test: add recycle log test 4e7e41b Disable lite build/testing for persistent read cache 1d725ca Deprecate BlockBasedTableOptions.hash_index_allow_collision=false. 0e77246 backupable_db.cc: lambada to explictly caputre "this" when escaping scope 2073cf3 Eliminate use of 'using namespace std'. Also remove a number of ADL references to std functions. 26adaad Split WinEnv into separate classes. (#1128) bb98ca3 Implement GetUniqueId for Mac 1f2dca0 Add MaxOperator to utilities/merge_operators/ f6e404c Added "number of merge operands" to statistics in ssts. 7383b64 Fix formatting of HISTORY.md (#1126) 0e665c3 Disable long running GroupCommitTest (#1125) 3c69f77 Move IO failure test to separate file 533cda9 Add GetStringFromCompressionType to include/rocksdb/convenience.h c70a933 Fix mutex unlock issue between scheduled compaction and ReleaseCompactionFiles() 05c5c39 Fix build a6254f2 Long outstanding prepare test 2ead115 Fix TransactionTest.TwoPhaseMultiThreadTest under TSAN 1f0142c Persistent Read Cache (Part 2) Data structure for building persistent read cache index 43afd72 [rocksdb] make more options dynamic bac3be7 Fix build issue. (#1123) f6aedb6 Fix Transaction memory leak a08c8c8 Added PersistentCache abstraction 5c06e08 [ldb] Templatize the Selector aab91b8 Use generic threadpool for Windows environment (#1120) a400336 TransactionLogIterator sequence gap fix fa3536d Store SST file compression algorithm as a TableProperty 40123b3 signed vs unsigned comparison fix 49815e3 [ldb] Export LDBCommandRunner c1af07c Disable backupable_db_test.cc on Windows e61ba05 Isolate db env and backup Env in unit tests 560358d Fix data race in GetObsoleteFiles() 5c1c904 ldb option for compression dictionary size c27061d [rocksdb] 2PC double recovery bug fix a657ee9 [rocksdb] Recovery path sequence miscount fix 8a66c85 [rocksdb] Two Phase Transaction 1b8a2e8 [rocksdb] Memtable Log Referencing and Prepared Batch Recovery 0460e9d Modification of WriteBatch to support two phase commit f548da3 Follow symlinks in chroot directory d86f9b9 Fix lite build 4b31723 Add bottommost_compression option bfb6b1b Estimate pending compaction bytes more accurately 258459e Properly destroy ChrootEnv in env_test fca5aa6 Initial script for the new regression test e1951b6 Add --index_block_restart_interval option in db_bench 730f7e2 Fix win build a9b3c47 Fix includes for clang on OS X 3f16a83 Introduce chroot Env 269f6b2 Revert "Modification of WriteBatch to support two phase commit" 04dec2a [ldb] Export ldb_cmd*.h 72c73cd Java API - Add missing HEADER_LEVEL logging (#1104) 4d02bfa Add support for PauseBackgroundWork and ContinueBackgroundWork to the Java API (#1087) 8f65fea Have sandcastle run lite_test for every diff 0d590d9 Make max_dict_bytes optional in options string 7ccb8d6 BlockBasedTable::Get() not to use prefix bloom if read_options.total_order_seek = true e3c6ba3 OptimizeForSmallDb(): revert some options whose defaults were just changed 967476e Fix valgrind (DBIteratorTest.ReadAhead) 9790b94 Add optimize_filters_for_hits option to db_bench a4ea345 Fixing lite build 24a24f0 Enable configurable readahead for iterators ff4b3fb Fix Iterator::Prev memory pinning bug cba752d sst_dump won't print size for unsupported compression type 6e801b0 Eliminate memcpy in Iterator::Prev() by pinning blocks for keys spanning multiple blocks 1b16692 Release RocksDB 4.8.0 b8cf913 Fix #1110, 32-bit build failure on Mac OSX (#1112) 21441c0 Fix calling GetCurrentMutableCFOptions in CompactionJob::ProcessKeyValueCompaction() 4ea6e05 Fix multiple issues with WinMmapFile fo sequential writing (#1108) f3bb024 Fix clang build 6e56a11 Modification of WriteBatch to support two phase commit 1d2e4ef ldb support new WAL records a92049e Added EventListener::OnTableFileCreationStarted() callback e8115ce Revert "Use async file handle for better parallelism (#1049)" (#1105) 6a14f7a Change several option defaults c6c770a Use prefix_same_as_start to avoid iteration in FindNextUserEntryInternal. (#1102) 992a8f8 Not enable jemalloc status printing if USE_CLANG=1 029022b Fix crash_test a06faa6 Skip PresetCompressionDict test for lite e7899c6 Fix build issue. (#1103) 0f428c5 Fix compression dictionary clang osx error 6d4832a Merge pull request #1101 from flyd1005/wip-fix-typo af70f9a Fix typo in build_tools/fbcode_config.sh 54de13a Fix compression dictionary clang errors 0850bc5 Fix build on machines without jemalloc 4032145 Configurable compression in db_bench 843d2e3 Shared dictionary compression using reference block ad573b9 Temporarily disable CompactFiles in db_stress in its default setting 1c80dfa Print memory allocation counters eb73980 Fix BackupableDBTest ac0e54b CompactedDB should not be used if there is outstanding WAL files d719b09 Introduce PinnedIteratorsManager (Reduce PinData() overhead / Refactor PinData) 1995e34 Retrieve file size from proper Env 7c14abf Improve BytewiseComparatorImpl::FindShortestSeparator f3eb0b5 Make EventListenerTest.CompactionReasonLevel more deterministic 7b78d62 Shouldn't report default column family's compaction stats as DB compaction stats 995353e Fix null-pointer-dereference detected by Infer (https://github.com/facebook/infer) 24110ce Correct Statistics FLUSH_WRITE_BYTES b71c4e6 Alpine Linux Build (#990) 90ffed1 Update USERS.md with link to LinkedIn blog post (#1088) 99a3bf8 Merge pull request #1068 from daaku/c-purge-old-backups b54c347 Use async file handle for better parallelism (#1049) c146c9b rocksdb_create_mem_env to allow C libraries to create mem env (#1066) 6da70c5 expose more options in the c api (#1067) 6f01687 C rocksdb_create_iterators to expose NewIterators (#1069) 644f978 Fix RocksDB Lite build in db_stress 5bd4022 Add comparator, merge operator, property collectors to SST file properties (again) 7a6045a fix typo in HISTORY.md 73a847e Add per-level compression ratio property ee221d2 Introduce XPRESS compresssion on Windows. (#1081) 874c96a Merge pull request #1083 from flabby/master 6cbffd5 Enable testing CompactFiles in db_stress b95510d Fix DBTest.RateLimitedDelete flakiness 6356b4d Fix nullptr dereference in adaptive_table 9385fd7 Delete deprecated backup classes in Java a2466c8 [db_stress] Make subcompaction random in crash_test c3c389d Fix column label for L0 write sum ec84bef New legocastle output parsing 725184b Fix db_block_cache_test in lite build 290883d Fix lite build 23089fd write_callback_test: clean test directory before running tests 792762c Split db_test.cc 40b840f Delete deprecated *BackupableDB interface for backups 6affd45 Make more tests run in parallel 47833e0 Merge branch 'master' of github.com:facebook/rocksdb e5c614e Fixing snapshot 0 assertion 1b1adeb Fixing snapshot 0 assertion 6d436a3 DBTest.HardLimit made more deterministic 994d9bc Make parallel valgrind watch-log more readable 9d35ae6 Make DBTestUniversalCompaction.IncreaseUniversalCompactionNumLevels more deterministic cea8ed9 Fix backupable_db_test test cases that can't run by itself 4b6833a Rename options.compaction_measure_io_stats to options.report_bg_io_stats and include flush too. 3894603 Allow valgrind_check to run in parallel c9d668c Fix unit tests issues on Windows (#1078) 083cadc Minor fix to Java sandcastle job definition 80b74a6 Include ldb tool in the windows build (#914) 7c14d11 Minor fix to java build job 535af52 BlockBasedTable::PrefixMayMatch() to skip index checking if we can't find a filter block. 09be5ca Minor fix to sandcastle java job definition 1aeca97 Release RocksDB 4.7 dfc3de8 Split Travis unittests Job c2c8fe4 Add Java job for sandcastle 19ef3de Fix ManualCompactionPartial test flakiness b345b36 Add a minimum value for the refill bytes per period value dff4c48 BlockBasedTable::PrefixMayMatch: no need to find data block after full bloom checking 0353b85 Propagate sandcastle run error to UI b885f33 Parallelize travis jobs 71303e0 Update db_bench_tool.cc (#1073) 63cf15b Fix option settable tests e208575 using java7 in runtime for hdfs env (#1072) 13e6c8e Relax an assertion in Compaction::ShouldStopBefore ae21d71 Fixed a bug in RocksDB Statistics where flush is considered as compaction 8e0e22f Fix Windows build by replacing strings.h include 5675d50 Revert travis commit 91f0f1f fix travis a23c605 Don't run DBOptionsAllFieldsSettable under valgrind 30d72ee PrefixTest.PrefixAndWholeKeyTest should run against a different directory from prefix_test 0e3cc2c Add column family info to TableProperties::ToString() 2448f80 Make sure that if use_mmap_reads is on use_os_buffer is also on 114a1b8 Fix build errors for windows 0522990 Improve sst_dump help message 0930e5e Update comments on include/rocksdb/perf_context.h 3b977bc instructing people to use java7 for hdfs (#1063) 1518b73 Change default number of cache shard bit to be 6 and max_file_opening_threads to be 16. ada88b6 fix wrong assignment of level0_stop_writes_trigger in spatialdb (#1061) 2391ef7 Embed column family name in SST file ab4c623 Don't use version in the error message d02eb8d Fix unused variable warning 9278097 Merge pull request #1056 from facebook/igorcanadi-patch-1 cc87075 No need to limit to 20 files in UpdateAccumulatedStats() if options.max_open_files=-1 8a1a603 Eliminate std::deque initialization while iterating over merge operands f38540b WriteBatchWithIndex micro optimization 2006540 Merge pull request #1053 from adamretter/benchmark-java-comparator f2c43a4 Stderr info logger b55e216 Rocksdb backup can store optional application specific metadata 9b51987 Adding pin_l0_filter_and_index_blocks_in_cache feature and related fixes. 2feafa3 Change some RocksDB default options a558830 Fixed compile warnings in posix_logger.h and coding.h 51c9464 Merge pull request #980 from adamretter/java-arm 925b5d0 Merge pull request #1054 from DCEngines/magic12 63e8f1b Formatted lines to adhere to 80 char limit 994b3bd Add support for UBsan builds to RocksDB 21700a5 to/from hex refactor 2442094 Replace kHeader by WriteBatchInternal::kHeader in few more places kHeader was moved from write_batch.cc to header file because it is being used wherever the number "12" was being used to check for record size 3bdbe89 Merge branch 'magic12' of https://github.com/dcengines/rocksdb into magic12 7871152 In all the places where log records are read, there was a check that record.size() should not be less than 12. e7c64fb Imporve sst_file_manager comment 99ffb3d Fix perf_context::merge_operator_time_nanos calculation 07bb12d Update internal jemalloc and other versions ad2fdaa Correct a typo in a comment be9816b Fix data race issue when sub-compaction is used in CompactionJob e380253 Merge pull request #1050 from yuslepukhin/support_db_test2 e7cc49c Add support for db_test2 for dev and CI runs 3996770 Add comments to perf_context skip counters 4e85b74 Make WritableFileWrapper not screw up preallocation ec458dc Merge pull request #1047 from PraveenSinghRao/wal_filter_ex 583157f Avoid overloaded virtual function b9d4fa8 Options settable tests to use a different special charactor 60e34ba Merge pull request #1044 from PraveenSinghRao/wal_filter_ex 136b8e0 Merge from master 2dcbb3b Addressed review comments b1fafca Revert "Adding pin_l0_filter_and_index_blocks_in_cache feature." 5f8741a Revert "Fix failing Java unit test." 43bbb56 tools/check_format_compatible.sh to use consistent version when testing backward and forward compatibility d7ae42b Fix failing Java unit test. fbbb8a6 Add test for Snapshot 0 e182f03 Add unit tests for RepairDB 7d37186 travis build fixes fbea4dc Merge pull request #1042 from SherlockNoMad/HistFix 780d2b0 Update format compatible checking tool 4f1c74a merge from master f8c2189 Publish log numbers for column family to wal_filter, and provide log number in the record callback 4475626 Reset block cache in failing unit test. 522de4f Adding pin_l0_filter_and_index_blocks_in_cache feature. be22271 Merge pull request #1041 from yuslepukhin/adjust_for_jemalloc 4ecc03c Fix in HistogramWindowingImpl 2ca0994 Latest versions of Jemalloc library do not require je_init()/je_unint() calls. #ifdef in the source code and make this a default build option. 90aff0c Update --max_write_buffer_number for compaction benchmarks 7222410 Forge current file for checkpoint 33d5686 Merge pull request #1040 from bureau14/master 02e62eb Fixes warnings and ensure correct int behavior on 32-bit platforms. 9cad568 Merge pull request #1039 from bureau14/master 3d29f91 Improve documentation of the allow_os_buffer parameter. 3ff98bd Fix no compression test b9cc42a Merge pull request #1038 from SherlockNoMad/HistFix f76b260 Fix FB internal CI build failure 774922c Merge pull request #1026 from SherlockNoMad/Hist 17b879b Merge pull request #1037 from SherlockNoMad/BuildFix f11b0df Fix AppVeyor build error 6b03f93 Fix the build break on Ubuntu 15.10 when gcc 5.2.1 is used 697fab8 Updates to RocksDB subcompaction benchmarking script 58379bf remove division from histogramwidowing impl 1a2cc27 ColumnFamilyOptions SanitizeOptions is buggy on 32-bit platforms. e778c34 Merge pull request #1035 from bureau14/master 5bd3da1 Added quasardb to the USERS.md file b2ae595 Index Reader should not be reused after DB restart 0267655 Update change log for 4.6 release 08304c0 Expose RepairDB as ldb command fd664a2 Fix Build Error 580fede Aggregate hot Iterator counters in LocalStatistics (DBIter::Next perf regression) 54f6b9e Histogram Concurrency Improvement and Time-Windowing Support 7902528 Add multithreaded transaction test e8e6cf0 fix: handle_fatal_signal (sig=6) in std::vector<std::string, std::allocator<std::string> >::_M_range_check | c++/4.8.2/bits/stl_vector.h:794 #174 d962023 Cleanup stale manifests outside of full purge f71fc77 Cache to have an option to fail Cache::Insert() when full ee8cc35 Merge pull request #938 from alexander-fenster/master 765597f Update compaction score right after CompactFiles forms a compaction f0161c3 formatting fix aa3f02d Improve comment in compaction.h and compaction_picker.h 2200295 optimistic transactions support for reinitialization badd6b7 Ignore db_test2 200080e Improve snapshot handling for Transaction reinitialization 171c8e8 Update dependencies / Fix Clang 294bdf9 Change Property name from "rocksdb.current_version_number" to "rocksdb.current-super-version-number" bf1c408 Use pure if-then check instead of assert in EraseColumnFamilyInfo a7d4eb2 Fix a bug where flush does not happen when a manual compaction is running 68189f7 Update benchmarks used to measure subcompaction performance dfe96c7 Fix WriteLevel0TableForRecovery file delete protection 451678c Merge pull request #1025 from SherlockNoMad/BuildFix 58ecd91 Fix Windows build 501927f [backupable db] Remove file size embedded in name workaround ef204df Compaction always needs to be removed from level0_compactions_in_progress_ for universal compaction e79ad9e Add Iterator Property rocksdb.iterator.version_number 19ea40f Subcompaction boundary keys should not terminate after an empty level deb08b8 Add parsing of missing DB options f8e90e8 Get file attributes in bulk for VerifyBackup and CreateNewBackup 12fd9b1 Change BlockBasedTableOptions.format_version default to 2 4572a2d Update current version to 4.6 74b6607 Rename iterator property "rocksdb.iterator.is.key.pinned" => "rocksdb.iterator.is-key-pinned" 6743135 Fix DB::AddFile() issue when PurgeObsoleteFiles() is called 432f3ad Add DB Property "rocksdb.current_version_number" 188bb2e Fix formatting identified by `arc lint` 0f2d2fc Refactored tests to use try-with-resources f8e02c7 Deprecate org.rocksdb.AbstractNativeReference#dispose() and implement java.lang.AutoCloseable 0f2fdfe Fix the javadoc and the formatting of the base-classes for objects with native references b5b1db1 Recompute compaction score after scheduling manual compaction 5ea9aa3 TransactionDB:ReinitializeTransaction 1f59541 Introduce Iterator::GetProperty() and replace Iterator::IsKeyPinned() 6778941 Merge pull request #1020 from gongsu832/master 69c471b Handle concurrent manifest update and backup creation 3373c81 Modify build_tools/build_detect_platform to detect and set -march=z10 on Linux s390x. 9905090 Merge branch 'master' of https://github.com/gongsu832/rocksdb 3492889 Merge pull request #1019 from javacruft/wip-omit-leaf-frame-pointer-archs 7ca731b build: Improve -momit-leaf-frame-pointer usage 21f17aa Modified Makefile and build_tools/build_detect_platform to compile on Linux s390x. 8800975 Make DBTestUniversalCompaction.IncreaseUniversalCompactionNumLevels more robust cd3fe67 Remove stale TODO 69c98f0 Reorder instance variables in backup test for proper destruction order 82f15fb Add test to make sure DropColumnFamily doesn't impact existing iterators 38201b3 Fix assert failure when DBImpl::SyncWAL() conflicts with log rolling 2568985 IOStatsContext::ToString() add option to exclude zero counters b046916 Redo SyncPoints for flush while rolling test 291ae4c Revert "Revert "Fixed the bug when both whole_key_filtering and prefix_extractor are set."" eef63ef Fixed CompactFiles() spuriously failing or corrupting DB 79ca039 Relax the check condition of prefix_extractor in CheckOptionsCompatibility 4b1b4b8 Merge pull request #1004 from yuslepukhin/child_attr 9ea2968 Implement ConsistentChildrenAttribute by using default implementation for now as it works. c7f1a8a Fix LITE build thread_local_test 0914f0c Merge pull request #1003 from yuslepukhin/fix_mutexlock_pthread_build d37d348 This addresses build issues on Windows https://github.com/facebook/rocksdb/issues/1002 d825fc7 Use condition variable in log roller test 6b2a047 Fix SstFileManager uninitialized data member a3db93c Remove the SyncPoint usage in the destructor of PosixEnv df9ba6d Introduce SstFileManager::SetMaxAllowedSpaceUsage() to cap disk space usage 3943d16 Fix race conditions in auto-rolling logger d733dd5 [build] Fix env_win.cc compiler errors cf38e56 Fix broken appveyor build caused by D53991 351252b Merge pull request #998 from fengjian0106/master 1336052 fix ios build error d08d502 Fix transaction locking 730a422 Improve the documentation of LoadLatestOptions a7b6f07 Improve write_with_callback_test to sync WAL 5bcf952 Fix WriteImpl empty batch hanging issue 871cc5f fix build without gflags c90d63a can_unlock set but not used 4437150 Fixed a segfault when compaction fails 2f084d3 Merge pull request #992 from jofusa/jdennison/options-typo-fix 7bd284c Separeate main from bench functionality to allow cusomizations bd5f842 fixes typo in options logging 1c868d6 Fix includes for env_test 545a193 Add J to commit_prereq so comilation/execution happens in parallel 5bb7371 [build] Evaluate test names only when db_test exists 6a2b4fc Add flag to forcibly disable fallocate 92a9ccf Add a new compaction priority that picks file whose overlapping ratio is smallest 3dc3d1c Merge pull request #984 from petermattis/pmattis/comparator-iterate-upper-bound 239aaf2 Use user_comparator when comparing against iterate_upper_bound. 9081003 Fixed a dependency issue of ThreadLocalPtr 337671b Add universal compaction benchmarks to run_flash_bench.sh 3a67bff Fix an ASAN error in transaction_test.cc c5af85e Fix a memory leak of Slice objects from org.rocksdb.WBWIRocksIterator#entry1 e84137c Remove unnessecary java.util.List expense in JNI 76e8bee Pass by pointer from/to Java from JNI not by object 0e7e6f6 Improve Javadoc 18eb563 Improve the speed and synchronization around the construction of Java/JNI objects 2a04268 Temporarily disable unstable tests in memory_test.cc 08a78b6 Merge pull request #979 from facebook/update_licenses 21e9581 Updated all copyright headers to the new format. 59b3ee6 Env function for bulk metadata retrieval 4a8cbf4 Allows Get and MultiGet to read directly from SST files. fe93bf9 Transaction::UndoGetForUpdate 2608219 crash_test: cover concurrent memtable insert in default crash test a76e909 Fix LITE db_test build broken by previous commit b1887c5 Explictly fail when memtable doesn't support concurrent insert 8ed3438 Add option to run fillseq with WAL enabled in addition to WAL disabled 73a9b0f Update version to 4.5 6f71d3b Improve perf of Pessimistic Transaction expirations (and optimistic transactions) 8e6172b Add BlockBasedTableOptions::index_block_restart_interval 34a40bf Add --allow_concurrent_memtable_write in stress test and run it in crash_test 73bf330 Merge pull request #973 from yuslepukhin/moveout_testcode f7c0f4e perf_context.cc and iostats_context.cc use different output macro (fix unity build) 9656eab This partially addresses issue https://github.com/facebook/rocksdb/issues/935 testutil.cc and testharness.cc could not be moved out at this time as they are used by 4 benchmarks in release builds. 14a3220 Remove references to files deleted in commit abb405227848581d3e6d2ba40d94dbc0a5513902 8445e53 Add a mechanism to run all tests in sandcastle 461cec4 Merge pull request #972 from adamretter/wb-threads 9ab269a Threaded tests for WriteBatch bf767c6 M…
aead40417 fix HISTORY.md typo a0cdc3cec Bump version to 5.8.7 7513f6350 Fix IOError on WAL write doesn't propagate to write group follower 9e47084ce Bump version to 5.8.6 36074ba5d Enable cacheline_aligned_alloc() to allocate from jemalloc if enabled. aa00523e0 Add -DPORTABLE=1 to MSVC CI build cf2b98237 Bump version to 5.8.5 e8c9350f2 Blob DB: not using PinnableSlice move assignment 4907d2463 Bump version to 5.8.4 5d928c795 Blob DB: Fix race condition between flush and write 725bb9d66 Blob DB: Fix release build b7367fe84 Bump version to 5.8.3 13b2a9b6f Blob DB: use compression in file header instead of global options 5dc70a15c Fix PinnableSlice move assignment 9019e9125 dynamically change current memtable size 7f1815c37 Bump version to 5.8.2 2584a18ef Blob DB: Fix BlobDBTest::SnapshotAndGarbageCollection asan failure 17f67b546 PinnableSlice move assignment 6fb56c582 Blob DB: Add compaction filter to remove expired blob index entries f90ced92f Blob DB: fix snapshot handling 632f36dcd Blob DB: option to enable garbage collection 11bacd578 Blob DB: Fix flaky BlobDBTest::GCExpiredKeyWhileOverwriting test f98efcb1e Blob DB: Evict oldest blob file when close to blob db size limit c1e99eddc Blob DB: cleanup unused options ffc3c62ca Blob DB: Initialize all fields in Blob Header, Footer and Record structs 9e8254090 Blob DB: update blob file format d66bb21e1 Blob DB: Inline small values in base DB 05d5c575a Return write error on reaching blob dir size limit 2b8893b9e Blob DB: Store blob index as kTypeBlobIndex in base db 419b93c56 Blob DB: not writing sequence number as blob record footer 8afb0036c fix lite build dded348dd Blob DB: Move BlobFile definition to a separate file 374736123 add GetLiveFiles and GetLiveFilesMetaData for BlobDB 8cff6e945 Enable WAL for blob index c29347290 Add ValueType::kTypeBlobIndex eae53de3b Make it explicit blob db doesn't support CF 65aec19df Fix memory leak on blob db open 30b38c98c TableProperty::oldest_key_time defaults to 0 2879f4beb Bump version to 5.8.1 88595c882 Add DB::Properties::kEstimateOldestKeyTime 266ac245a Bumping version to 5.8 64185c23a update HISTORY.md for DeleteRange bug fix e83d6a02e Not using aligned_alloc with gcc4 + asan 0980dc6c9 Fix wrong smallest key of delete range tombstones b76797231 avoid use-after-move error c41744270 CMake: Fix formatting c21ea8f7a CMake: Add support for CMake packages 544434558 add Erlang to the list of language bindings 2972a702a Minor updates to FlushWAL blog fbfa3e7a4 WriteAtPrepare: Efficient read from snapshot list b01f426f5 Blog post for FlushWAL 503db684f make blob file close synchronous 3c840d1a6 Allow DB reopen with reduced options.num_levels 92bfd6c50 Fix DropColumnFamily data race 7fdf735d5 Pinnableslice examples and blog post 7fbb9ecca support disabling checksum in block-based table 19cc66dc4 fix clang bug in block-based table reader 7eba54eb9 test compaction input-level split range tombstone assumption cd26af347 Add unit test for WritePrepared skeleton a12479819 Improved transactions support in C API c10b39131 LANGUAGE-BINDINGS.md: add another rust binding 90177432e Remove leftover references to phutil_module_cache 234f33a3f allow nullptr Slice only as sentinel ccf7f833e Use PinnableSlice in Transactions 1dfcdb15f Extend pin_l0 to filter partitions 39ef90055 stop calling memcmp with nullptrs 78cb6b611 Provide byte[] version of SstFileWriter.merge to reduce GC Stall 867fe92e5 Scale histogram bucket size by constant factor f004307e9 CMake improvements 09ac6206a Circumvent ASAN false positive 5b68b114f Blob db create a snapshot before every read 4624ae52c GC the oldest file when out of space 8ace1f79b add counter for deletion dropping optimization 0d8e992b4 Revert the mistake in version update 5358a8056 add VerifyChecksum to HISTORY.md ed0a4c93e perf_context measure user bytes read 1efc600dd Preload l0 index partitions bddd5d363 Added mechanism to track deadlock chain c1384a707 fix db_stress uint64_t to int32 cast 29877ec7b Fix blob db crash during calculating write amp 8f2598ac9 Enable Cassandra merge operator to be called with a single merge operand 9a44b4c32 Allow merge operator to be called even with a single operand ac8fb77af fix some misspellings 23593171c minor improvements to db_stress af012c0f8 fix deleterange with memtable prefix bloom 1c8dbe2aa update scores after picking universal compaction eb6425303 Update WritePrepared with the pseudo code 132306fbf Remove PartialMerge implementation from Cassandra merge operator 71598cdc7 Fix false removal of tombstone issue in FIFO and kCompactionStyleNone 3204a4f64 Fix missing stdlib include required for abort() 7aa96db7a db_stress rolling active window dfa6c23c4 Update RocksDBCommonHelper to use escapeshellarg e367774d1 Overload new[] to properly align LRUCacheShard ad42d2fcb Remove residual arcanist_util directory 279296f4d properly set C[XX]FLAGS during CMake configure-time checks c5f0c6cc6 compile with correct flags to determine SSE4.2 support 185ade4c0 cmake: support more compression type 5449c0990 rocksdb: make buildable on aarch64 a144a9782 Fix for CMakeLists.txt on Windows for RocksJava acf935e40 fix deletion dropping in intra-L0 8254e9b57 make sst_dump compression size command consistent 74f18c130 db_bench support for non-uniform column family ops 5de98f2d5 approximate histogram stats to save cpu 3f5888430 Fix c_test ASAN failure e5a1b727c Fix blob DB transaction usage while GC 6f051e0c7 fix corruption_test valgrind ac098a462 expose set_skip_stats_update_on_db_open to C bindings 666a005f9 Support prefetch last 512KB with direct I/O in block based file reader ad77ee0ea Revert "Makefile: correct faligned-new test" b87ee6f77 Use more keys per lock in daily TSAN crash test 25df24254 Add column families related functions (C API) 64f848435 block_cache_tier: fix gcc-7 warnings 0cecf8155 Write batch for `TransactionDB` in C API 6a9de4347 Windows.h macro call fix 23c7d1354 fix comment 1fbad84b6 Makefile: correct faligned-new test 7848f0b24 add VerifyChecksum() to db.h 47ed3bfc3 fix WinEnv assertions d97a72d63 Try to repair db with wal_dir option, avoid leak some WAL files 36375de76 gcc-7/i386: markup intentional fallthroughs bdc056f8a Refactor PessimisticTransaction a9a4e89c3 Fix valgrind complaint about initialization 4ca11b4b0 Update USERS.md c9804e007 Refactor TransactionDBImpl 20dc5e74f Optimize range-delete aggregator call in merge helper. 0d4a2b733 Avoid blob db call Sync() while writing 627c9f1ab Don't add -ljemalloc when DISABLE_JEMALLOC is set dce6d5a83 db_bench background work thread pool size arguments 4f81ab38b Makefile: fix for GCC 7+ and clang 4+ 92afe830f Update all blob db TTL and timestamps to uint64_t 5883a1ae2 Fix /bin/bash shebangs cc01985db Introduce bottom-pri thread pool for large universal compactions 0b814ba92 Allow concurrent writes to blob db 2c45ada4c Blob DB garbage collection should keep keys with newer version 58410aee4 Fix the overflow bug in AwaitState c3d5c4d38 Refactor TransactionImpl 060ccd4f8 support multiple CFs with OPTIONS file 345387067 Fix statistics in RocksJava sample 1900771bd Dump Blob DB options to info log 3218edc57 Fix universal compaction bug 6a36b3a7b fix db get/write stats a84cee812 Add a missing "once" in .h 21696ba50 Replace dynamic_cast<> e85f2c64c Prevent empty memtables from using a lot of memory ac748c57e Fix FIFO Compaction with TTL tests aaf42fe77 Move blob_db/ttl_extractor.h into blob_db/blob_db.h aace46516 Fix license headers in Cassandra related files 50a969131 CacheActivityLogger, component to log cache activity into a file 6083bc79f Blob DB TTL extractor 710411aea fix asan/valgrind for TableCache cleanup 3a3fb00b7 TARGETS file not setting sse explicitly fca4d6da1 Build fewer tests in Travis platform_dependent tests 8f553d3c5 remove unnecessary internal_comparator param in newIterator 7f6d012d7 "ccache -C" in Travis d12691b86 move TableCache::EraseHandle outside of db mutex f33f11368 fix db_bench argument type e7697b8ce Fix LITE unit tests 3ce20e985 Fix use of RocksDBCommonHelper in cont_integration.sh c281b4482 Revert "CRC32 Power Optimization Changes" 9980de262 Fix FIFO compaction picker test 2289d3811 CRC32 Power Optimization Changes 30b58cf71 Remove the orphan assert on !need_log_sync fe1a5559f Fix flaky write_callback_test addbd279c 5.6.1 release blog post 30edff308 buckification: remove explicit `-msse*` compiler flags 2b259c9d4 Lower num of iterations in DeadlockCycle test 277f6f23d Release note for partitioned index/filters 5e731a138 Remove unused rocksdb arcanist lib 9b11d4345 Fix broken links 06f191744 add vcpkg as an windows option ea8ad4f67 Fix compaction div by zero logging 34112aeff Added db paths to c 1d8aa2961 Gcc 7 ParsedInternalKey replace memset with clear function. a4c42e800 Fix UBSAN issue of passing nullptr to memcmp 16e038820 LRUCacheShard cache line size alignment 216644c61 enable UBSAN macro in TARGETS e67b35c07 Add Iterator::Refresh() a34b2e388 Fix caching of compaction picker's next index 72502cf22 Revert "comment out unused parameters" 1d7048c59 comment out unused parameters 534c255c7 Cassandra compaction filter for purge expired columns and rows 63163a8c6 Remove make_new_version.sh 0302da47a Reduce blob db noisy logging 3e5ea29a8 Fix Flaky DeleteSchedulerTest::ImmediateDeleteOn25PercDBSize a22b9cc6f overlapping endpoint fixes in level compaction picker ffd2a2eef delete ExpandInputsToCleanCut failure log 3e6e863b1 Remove arcanist_util directory 36651d14e Moving static AdaptationContext to outside function 6e3ee015f Update java/rocksjni.pom ecff9d5e3 Include write_buffer_manager in ImmutableDBOptions::Dump ae28634e9 Remove some left-over BSD headers 33b1de82a Remove format compatibility hack 2f375154e checkout local branch in check_format_compatible.sh ddb22ac59 avoid collision with master branch in check format 0c03a7f17 set the remote for git checkout 7ac184c6d Revert cmake -DNDEBUG for non-MSVC 0655b5858 enable PinnableSlice for RowCache 00464a314 Fix column_family_test with LITE build b2dd192fe tools/write_stress.cc: Correct "1204" typos. cbaab3044 table/block.h: change memset f1a056e00 CodeMod: Prefer ADD_FAILURE() over EXPECT_TRUE(false), et cetera 4a2e4891f Add back the LevelDB license file a7321fc97 Remove the licensing description in CONTRIBUTING.md 3c327ac2d Change RocksDB License 132013366 Make TARGETS file portable ccf5f08f8 Set CACHE_LINE_SIZE for s390, PPC, ARM64 67510eeff db_crashtest.py: remove need for shell 4267eb00d Remove punit tests 5bfb67d90 Enable write rate limit for updaterandom benchmark 20a691d98 Update HISTORY to release 5.7 98d1a5510 db_bench to by default verify checksum 26ce69b19 Update blob db to use ROCKS_LOG_* macro 43e4eef77 remove unnecessary fadvise 21b17d768 Fix BlobDB::Get which only get out the value offset 70440f7a6 Add virtual func IsDeleteRangeSupported 7550255c5 Add JAVAC_ARGS as Makefile variable 7a0b5de77 Gcc 7 ignored quantifiers 000bf0af3 Improve the design and native object management of Stats in RocksJava 269d383d5 Bump version to 5.7 c32f27223 Fixes db_bench with blob db fcd99d27c db_bench_tool: fix buffer size 87128bd5c fix regression test 8f927e5f7 Fix undefined behavior in Hash 643b787c7 Added a note about LZ4 compression dependency 56656e12d Temporarily disable FIFOCompactionWithTTLTest b5fb85ec5 fix valgrind init complaint 657df29ea Add max_background_jobs to db_bench a43c053ad remove duplicated utilities/merge_operators/cassandra/test_utils.cc in src.mk 7c4a9e6c9 Initialize a variable in ldb to make code analysis tool happy 98669b535 init filters_in_partition_ 0013bf14e fix asan and valgrind leak report in test 521b4c28b rocksdb 5.5.1 release post 33042573d Fix GetCurrentTime() initialization for valgrind f6b9d9355 Fix clang error in PartitionedFilterBlockBuilder 45b9bb033 Cut filter partition based on metadata_block_size f4ae1bab0 update history for OnBackgroundError and DeleteRange fix 1cb8c6de6 Add -enable_pipelined_write to db_bench and add two defaults 7604b463b Update the AddDBStats in LITE 1e34d07e1 Simplify and document sync rules for logs_ etc d310e0f33 Regression test for empty dedicated range deletion file e9f91a517 Add a fetch_add variation to AddDBStats c1b375e96 skip generating empty sst 67b417d62 fix format compatible test afbef6518 Bug fix: Fast CRC Support printing is not honest 397ab1115 Improve Status message for block checksum mismatches 18c63af6e Make "make analyze" happy 01534db24 Fix the reported asan issues 1cd45cd1b FIFO Compaction with TTL 982cec22a Fix TARGETS file tests list b49b37109 allow numa >= 2.0.8 e517bfa2c CLANG Tidy dc3d2e4d2 update compatible test 89468c01d Fix Windows build broken by 5c97a7c0664d4071768113814e9ba71fe87e18cf 51778612c Encryption at rest support 7061912c2 Trivial typo in HISTORY.md 2a9cd8799 Fix jni WriteBatchThreadedTest 0025a3640 revert perf_context and io_stats to __thread 5c97a7c06 Unit Tests for sync, range sync and file close failures 4cee11f4e Intra-L0 blog post 857e9960b Improve the error message for I/O related errors. d757355cb Fix bug that flush doesn't respond to fsync result 8e6345d2d Update rename of ParanoidCheck 499ebb3ab Optimize for serial commits in 2PC 0ac4afb97 Sanitize partitioning options 521724ba8 fixed wrong type for "allow_compaction" parameter 71f5bcb73 Introduce OnBackgroundError callback 88cd2d96e Downgrade option sanitiy check level for prefix_extractor 6837a1762 Fix Data Race Between CreateColumnFamily() and GetAggregatedIntProperty() af1746751 WriteBufferManager will not trigger flush if much data is already being flushed 9467eb614 Fix flush assertion with tsan 048446fc7 Fix cassandra ASAN use-after-free a21db161c Implement ReopenWritibaleFile on Windows and other fixes c430d69ee fix coredump for release nullptr 0d278456c default implementation for InRange cbd825dee Create a MergeOperator for Cassandra Row Value 2c98b06bf Remove pin_slice option by making it the default c80c6115d add db_bench options for partitioning 6a3377f45 Synchronize statistic enumeration values between statistics.h and java API 53dda8797 Do not run RateLimiterTest.Rate test on Travis+Mac OSX. ae8571f5c Fix blob db compression bug 7a380deff Update blob_db_test 89ad9f3ad Allow ignoring unknown options when loading options from a file 6b5a5dc5d fixed typo 0f228be3b fixed typo in util/dynamic_bloom.h c217e0b9c Call RateLimiter for compaction reads 91e2aa3ce write exact sequence number for each put in write batch 6f4154d69 record index partition properties 5d5a28a98 Fix Clang release build broken by 5582123dee8426a5191dfd5e846cea8c676c793c 0175d58c3 Make direct I/O write use incremental buffer 7a270069b GNU C library for struct tm has 2 additional fields. d713471da Limit trash directory to be 25% of total DB 9bb91e932 Dedup release 27b450165 Update HistogramTypes in the Java API e97304c68 update history for 5.6 5582123de Sample number of reads per SST file db818d2d1 Fix RocksDB Lite build with CLANG a472c4ae4 update 5.5 change log bc09c8a0d Fix crash in PosixWritableFile::Close() when fstat() fails 6d0f22e42 Fix mock_env.cc uninitialized variable c2012d488 Java APIs for put, merge and delete in file ingestion 85dace2af Disable DBRangeDelTest::TailingIteratorRangeTombstoneUnsupported for ubsan d4f7731b6 fix travis error with init time in mockenv 550a1df72 Fix clang errors by asserting the precondition cc5f9339e Fix concurrency issue with filter_block_set_ 2e64f450d bump version to 5.6 afbc2d0d2 Force travis to build with clang on MacOS b172a3f1a Fix warnings while generating RocksJava documentation 52a7f38b1 WriteOptions.low_pri which can throttle low pri writes if needed 26a8a8071 Switch from CentOS 5 to CentOS 6 for crossbuilding RocksJava dba9f3722 Fix db_write_test clang/windows build failure c7662a44a fixed typo 7e8d95cc0 Fix the Java build which was broken by a4d9c02 7e5fac2c3 remove test dir before exit when current regression is running 7f6c02dda using ThreadLocalPtr to hide ROCKSDB_SUPPORT_THREAD_LOCAL from public… 138b87eae Fix interaction between CompactionFilter::Decision::kRemoveAndSkipUnt… 95b0e89b5 Improve write buffer manager (and allow the size to be tracked in block cache) a4d9c0251 Pass CF ID to MemTableRepFactory f68d88be5 Fix DBWriteTest::ReturnSequenceNumberMultiThreaded data race 215076ef0 Fix TSAN: avoid arena mode with range deletions 3a8a848a5 account for L0 size in estimated compaction bytes 0fae3f5dd codemod: format TARGETS with buildifier [5/5] (D5092623) 872199606 add checkpoint support for single db in regression test 5a9b4d743 Retire memenv https://github.com/facebook/rocksdb/pull/2082 d6019651b sync internal/external TARGETS bbaba51bb Add missing index type to C-API 292edfd51 travis: test with xcode8.3 (OS X 10.12) 0dc3040d5 db: avoid `#include`ing malloc and jemalloc simultaneously 9b3ed8350 fix regression test 9c9909bf7 Support ingest file when range deletions exist ad19eb868 Fixing blob db sequence number handling 51ac91f58 Histogram of number of merge operands 345878a7f update blob_db_test cbc821c25 change regression rebuild to one level 103d0692e Avoid unsupported attributes when not building with UBSAN 5fd04566c travis: reduce the number of travis builders 2d05002b9 RocksDB 5.4.5 release blog post 7eca90f18 Update RocksDB blog authors d03c34497 update comment of GetNextFile f7bb1a006 support merge and delete in file ingestion c2c62ad4e Reorder variables of ReadOptions 7bb1f5d48 Increase of compaction threads should be logged at info level instead of a warning 6c456ecae Clean zstd files 347e16f83 codemod: replace `headers = AutoHeaders.*` with `auto_headers` 0be636bf7 Fix db_bench build break with blob db 135ee6a3f fix tsan crash data race a99fb9928 fix column_family_test asan f41bffb3d travis: clang-3.6 -> clang-4.0 e7612798b update buckifer/TARGETS bb01c1880 Introduce max_background_jobs mutable option 5a2530462 Fix the CMakeLists for RocksJava 41cbb7274 options.delayed_write_rate use the rate of rate_limiter by default. 506803466 range sync should be enabled 02594b5f1 Fix build errors in blob_dump_tool with GCC 4.8 52d9e5f7b Fix column family seconds_up accounting 7d8207f1f Fix errors in clang-analyzer builds 85b8569ae Fix release build on Linux 69ec8356b Allow SstFileWriter to use the rate limiter 6cc9aef16 New API for background work in single thread pool 9d0a07ed5 Fix rocksdb.estimate-num-keys DB property underflow 578fb0b1d Simple blob file dumper ac39d6bec Core-local statistics 3e86c0f07 disable direct reads for log and manifest and add direct io to tests 15ba4d6c4 Address MS Visual Studio 2017 issue with autovector 88c818e43 Replace deprecated RocksDB#addFile with RocksDB#ingestExternalFile 228f49d20 Fix data races caught by tsan 4c9d2b104 remove #include port/port.h in public header file 07bdcb91f New WriteImpl to pipeline WAL/memtable write d746aead1 Suppress clang-analyzer false positive 217b866f4 column_family_test: EnvCounter::num_new_writable_file_ to be atomic 9f839a7f6 keep util/build_version.cc when make clean 7eecd40a4 add emacs tags file - etags 9bbba4fec Remoe unused BlockBasedTable::compaction_optimized_ f5ba131bf Fixed some spelling mistakes 146b7718f Fix mingw compilation with -DNDEBUG a36220ccf fix unity test 0ebdd7057 fixed typo 8032f4cb3 Remove -pie in TSAN 362ba9b02 Release RocksDB 5.5.0 ba685a472 Support ingest_behind for IngestExternalFile 01ab7b528 Add ROCKSDB_LIBRARY_API macro to a few C APIs, to fix windows build cb9392a09 add Transactions and Checkpoint to C API 445f1235b s/std::snprintf/snprintf cd593c283 Fix travis java_test f720796e2 fixed typo a48a62d5b define NDEBUG in CMake non-debug builds 1ca723dbd C API: support pinnable get 2ef15b85d Core-local stats blog post 4f9e69ccf fix log err 11c5d4741 cross-platform compatibility improvements d00433302 Put lib files into suitable path in RPM package 86d549253 Fix build error with blob DB. 254c46800 Fix the RocksJava Release on Windows 7a47b431f Fix .gitignore pattern fa5a15ceb Make sure that zstd is statically linked correctly in the Java static build 3fa9a39c6 Add GetAllKeyVersions API 1a60982a5 Simplified instructions for CentOS a5cc7ecec Facility for cross-building RocksJava using Docker ccd3dddf5 Blog post for partitioned index/filters b145c34d7 Update blog authors bbe9ee7dd core-local array type conversions c2be43430 Build and link with ZStd when creating the static RocksJava build c61e72c42 Add missing files of blob_db to CMake file 3907c94ff Fix ColumnFamilyTest:BulkAddDrop cda5fde2d CoreLocalArray class 93949667c update TARGETS 4e83b8001 title: Bulkoading -> title: Bulkloading d85ff4953 Blob storage pr 492fc49a8 fix readampbitmap tests be421b0b1 portable sched_getcpu calls 0f559abdb Add NO_UPDATE_BUILD_VERSION option to makefile 3a04a254a Flink state 35df23fe8 Fix suite exclisions e7cea86f7 Fixes the CentOS 5 cross-building of RocksJava 259a00eac unbiase readamp bitmap a62096696 port: updated PhysicalCoreID() df035b682 Print compaction_options_universal.stop_style in LOG file 4897eb250 dont skip IO for filter blocks 3f73d54bb Add C API to set max_file_opening_threads option 0b69e5079 Define CACHE_LINE_SIZE only when it's not defined 2cd00773c Add bulk create/drop column family API 40af2381e Object lifetime in cache fdaefa030 travis: add Windows cross-compilation a30a69603 do not read next datablock if upperbound is reached 2d42cf5ea Roundup read bytes in ReadaheadRandomAccessFile 264d3f540 Allow IntraL0 compaction in FIFO Compaction 8c3a180e8 Set lower-bound on dynamic level sizes 7c1c8ce5a Avoid calling fallocate with UINT64_MAX a45e98a5b max_open_files dynamic set, follow up 6b99dbe04 fix memory alignment with logical sector size e7ae4a3a0 Max open files mutable 60847a3b0 port: updated PhysicalCoreID() b551104e0 support PopSavePoint for WriteBatch 498693cf3 Remove orphaned Java classes 5e2ebf2bd travis: add CMake compilation af6fe69e4 Fix an issue of manual / auto compaction data race 6798d1f3b Revert "Delete filter before closing the table" 89833577a Delete filter before closing the table 47a09b0a8 Avoid pinning when row cache is accessed aeaba07b2 Remove an assert that causes TSAN failure. 0b90aa951 Set VALGRIND_VER a2b05210e Make PosixLogger::flush_pending_ atomic da4b2070b Fix WriteBatchWithIndex address use after scope error d616ebea2 Add GPLv2 as an alternative license. 4439b4596 Add documentation license 0ca3ead0c add GetRootDB() in DeleteFilesInRange cdad04b05 Remove double buffering on RandomRead on Windows. e15382c09 Disable two flaky tests 2150cc1f3 fix WritableFile buffer size in direct IO efc361ef7 Add user stats Reset API 6616e4d62 add prefetch to PosixRandomAccessFile in buffered io f6a27d0bc Extract statistics tests into separate file 7eddecce1 support bulk loading with universal compaction 3b4d1b7a4 add <sys/sysmacros.h> to avoid warning with glibc 2.25 e5e545a02 Reunite checkpoint and backup core logic 72c21fb3f call GetRootDB() before cast to DBImpl* in CancelAllBackgroundWork 4c9447d88 Add erase option to release cache 04d58970c AIX and Solaris Sparc Support afff9951e Respect deprecated flag in table options 066cfbacc Adding -noprofile to CMakeLists for Windows cb885bccf set compaction_iterator earliest_snapshot to max if no snapshot 7534ba7bd StackableDB should pass ResetStats() c1fbf91b2 Fixing Solaris Sparc crash due to cached TLS 963eeba48 Revert how check_format_compatible.sh checkout release branches. 97005dbd5 tools/check_format_compatible.sh to cover option file loading too 8f6196788 Add cpu usage to regression benchmarks (4th attempt) df74b775e Limit backups opened 1dd776051 Change L0 compaction score using level size 927bbab25 Revert "Add cpu usage to regression benchmarks (3rd attempt)" 8e84a388e Re-add index_per_partition but as deprecated 1553659d6 Add more recent versions to tools/check_format_compatible.sh 966ebb02f Hide event listeners from lite build 476e80be8 Add cpu usage to regression benchmarks (3rd attempt) c49d70465 Add DB:ResetStats() 0fcdccc33 Blob storage helper methods a6439d797 CMake: compile with -O2 e67f0adf3 enable O2 optimization for lz4 bc3973259 CMake: add support for SSE4.2 7d5f5aa97 Separate compile and link for shared library 071652734 remove warning 6e8d6f429 readahead backwards from sst end ca96654d8 Change Build Env to gcc-5 e9e6e5324 Simplify write thread logic 6799c7e00 Pass in remote as a param to branch creation script 44fa8ece9 change use_direct_writes to use_direct_io_for_flush_and_compaction 13b50358f add space for buggy kernel warning b6b9359ec Fix BYTES_WRITTEN accounting 13369fbd4 Update ShipIt to honor TARGETS updates f2449ce92 Remove .deprecated_arcconfig 415be221c RocksDB Release 5.4 : Update HISTORY.md and build version. 3eab41d7c java dependencies test -s -> use test -d a22ed4eab internal_repo_rocksdb to build Java and RocksDB LITE 9f2cc59ec sync TARGETS file 10d754696 set readahead buffer size from roundup(user_size) + 4k to roundup(use… ba7da434a fix db_stress crash caused by buggy kernel warning 6257837d8 Add ROCKSDB_JAVA_NO_COMPRESSION flag 6a6723ee1 Move MergeOperatorPinning tests to be with other merge operator tests 6a8d5c015 Revert "Report cpu usage using time command" 8f47a9751 File level histogram should be printed per CF, not per DB 9300ef545 Fix shared lock upgrades 1f8b119ed Limit maximum memory used in the WriteBatch representation 97ec8a134 Report cpu usage using time command 20778f2f9 Adding comments to the write path 7124268a0 Reduce the number of params needed to construct DBIter 04abb2b2d FreeBSD only requires WITH_JEMALLOC, not the rest 61730186d dummy diff 360e9960f Summary: Remove .arcconfig 69a5e6461 Deprecate .arcconfig 9690653db Add a verify phase to benchmarks dd8f9e38e Fix compilation for GCC-5 c2954f9b6 Add Travis job to build examples 72fc1e9d0 avoid non-existent O_DIRECT on OpenBSD ff9728701 Refactor compaction picker code 9e7293902 only FALLOC_FL_PUNCH_HOLE when ftruncate is buggy 343b59d6e Move various string utility functions into string_util 1d068f606 Fix CompactRange incorrect buffer release df6f5a377 Move memtable related files into memtable directory 107c5f6a6 CMake: more MinGW fixes d2dce5611 Move some files under util/ to separate dirs c50e3750d Use a human readable size for level report ce64b8b71 Divide db/db_impl.cc 02799ad77 Revert "delete fallocate with punch_hole" e2a7b202c Release note for partition filters af256eb2b build db every monday e5a1372b2 Rework test running script. d659faad5 Level-based L0->L0 compaction a12306fab Add a notice on gflags installation in INSTALL.md 43010a929 Revert "[rocksdb][PR] CMake: more MinGW fixes" a30b75cdc Add buckifier script to github repo 3450ac8c1 CMake: more MinGW fixes 90cfd4645 update IterKey that can get user key and internal key explicitly e2c6c0636 add TimedEnv 9e4453180 Refactor WriteImpl (pipeline write part 1) 6ef8c620d Move auto_roll_logger and filename out of db/ a1c469d71 Add release notes for PinnableSlice 0537f515c fix run_remote with strong quoting 72e600094 fixed misses on Centos library installation instructions 88cc81df5 auto_roll_logger_test to move away from real sleep d25e28d58 replace sometimes-undefined uint type with unsigned int a1d7e487b Add L0 write-amp to compaction level stats b6d609063 CMake: support AVX2 in MinGW bd7d13835 test remote instead run remote in regression test c81a805fe test db existence on the remote host 5fc1e6765 add -rf when remove db in regression test 4ab4049f2 gflags has moved to GitHub 4e0065015 make all DB::Get overloads virtual 6401a8b76 Fix build with MinGW 80fe5b385 disable test: DeleteSchedulerTest.DynamicRateLimiting1 a9c86f51b backup garbage collect shared_checksum tmp files da175f7ec exit with code 2 when there is already a db_bench running in regression test 0ee7f0403 Added missing options to RocksJava c6d04f2ec Option to fail a request as incomplete when skipping too many internal keys 58179ec4a Cleanup of ThreadStatusUtil structures should use the DB's reference f3607640a add ldb build to regression test 8a8c96746 Enable Fast CRC32 for Win64 f9813b853 Added SstFileWriter construtor without explicit comparator to JNI api 8d3cb4f20 Added naming of backup engine threads 67d762379 Expose the stalling information through DB::GetProperty() 0fd574926 delete fallocate with punch_hole 41fe9ad75 Hide usage of compaction_options_fifo from lite build e7731d119 Configure index partition size 69c8d524a Fix jni library name for PowerPC Architecture 34a70859b Fix segmentation fault caused by #1961 8dee8cad9 Enable fifo compaction benchmark to db_bench a5c8b5434 fix a header include 91b5feb37 Fix Windows Build broken by a recent commit 41ccae6d2 Add C API functions (and tests) for WriteBatchWithIndex 88bb6f6bf non_shm CI should run tests on /tmp 8888de2b1 Update .gitignore file in examples 203136e79 Fix Compilation errors when using IBM Java f4fce4751 Fix clang compile error - [-Werror,-Wunused-lambda-capture] a084b26a5 Blog post for releasing 5.2.1 15950fe3a Remove ASSERT_EQ(boolean, ...) 3e56c7e0c make total_log_size_ atomic 909028e21 HISTORY.md for log_size_for_flush in CreateCheckpoint() be723a8d8 Optionally construct Post Processing Info map in MemTableInserter e474df947 db_bench: not need to check mmap for PlainTable 8b0097b49 Readers for partition filter 9ef3627fd Allow checkpointing without flushing 17866ecc3 Allow Users to change customized ldb tools' header in help printing a2a883318 remove deleted option from benchmark.sh 78cb19559 add checkpoint to ldb 4b04addfc updated solution if "make format" command fails 8f5bf0446 Flush triggered by DB write buffer size picks the oldest unflushed CF 6908e24b5 dynamic setting of stats_dump_period_sec through SetDBOption() 93c68b642 change regression bash file with debug mode 21d8c3179 remove LIKELY from public headers 36ad75778 INSTALL: document USE_SSE 9272e12f1 avoid ftruncate twice in buffered io d52f334cb Break stalls when no bg work is happening e66221add fix db_bench rate limiter callsites dbae438a0 Replace "DEPRECATED" comment to "not supported" 995618a82 Support SstFileManager::SetDeleteRateBytesPerSecond() e19163688 Add macros to include file name and line number during Logging d525718a9 cleanup direct io flag in WritableFileWriter 5fa927aa9 Add Xpress and ZSTD CompressionType values to C header 11526252c Pinnableslice (2nd attempt) e5bd8def1 update history.md for fixing the bug that skips keys 1ffbdfd9a Add a new SstFileWriter constructor without explicit comparator ebd5639b6 Add ability to search for key prefix in sst_dump tool e6725e8c8 Fix some bugs in MockEnv 900c62be6 fix compile for VS2015 fe1835617 release 5.3 5dae01947 Revert "Report cpu usage using time command" f2817fb7f avoid ASSERT_EQ(false, ...); 5b11124e3 add max to histogram stats d43adf21b Report cpu usage using time command 18fc1bc0e minor changes for rate limiter test flakiness 12ba00ea6 Reset DBIter::saved_key_ with proper user key anywhere before pass to DBIter::FindNextUserEntry c9df05d1e Fix random access alignment f64991537 Add Bulkoading IngestExternalFile blog post 54b434110 Builders for partition filter 97edc72d3 Add a memtable-only iterator 72202962f fix db_sst_test flakiness 5f65dc877 Expose DB::DeleteRange and WriteBath::DeleteRange in Java 58b12dfe3 Set logs as getting flushed before releasing lock, race condition fix f8a4ea020 Move db_test and external_sst_file_test out of Travis's MAC OS run 534581a35 Fix a bug in tests in options operator= a2f7a514d Refactoring 2a5daa06f Add stderr log level for ldb backup commands 4561275c2 fix rate limiter test flakiness 7c80a6d7d Statistic for how often rate limiter is drained 0ad5af42d Clarify VerifyBackup behavior 6fb901344 sanitize readahead when direct read enabled f89b3893c Remove skip_table_builder_flush and default it to true cc253982d Use more default options in db_bench 8432bcf55 Make compaction_pri settable through option string d5b607a43 Make db_wal_test slightly faster ba4c77bd6 Divide external_sst_file_test e877afa08 Remove bulk loading and auto_roll_logger in rocksdb_lite 90d835507 Fix the wrong address for PREFETCH in DynamicBloom::Prefetch 08864df21 Move advanced column family options to advanced_options.h 2ca2059f6 Get unique_ptr to use delete[] for char[] in DumpMallocStats 253799c06 Add missing include for `abort()` c6d464a9d Fixed various memory leaks and Java 8 JNI Compatibility be3e5568b Fix unaligned reads in read cache 8ad0fcdf9 Separate small subset tests in DBTest 6c951c43c Run fewer tests in OSX f7997f134 add direct I/O to version notes 5.2.0 3b8ba703c Fix flaky DBTestUniversalCompaction.UniversalCompactionTrivialMoveTest2 96c7e1504 Fix Java build e0b87afc7 Black list some slow valgrind tests e67232cff Handle failed Finish() in SST file writer 8efb5ffa2 [rocksdb][PR] Remove option min_partial_merge_operands and verify_checksums_in_comp… 1ba2804b7 Remove XFunc tests e7d902e69 add direct_io and compaction_readahead_size in db_stress 1ef5f50e8 detect logical sector size ed50308d2 check backup directory exists before listing children 4d7c06ced Make WriteBatchWithIndex moveble 5040414e6 Gracefully handle previous backup interrupted f206af56f add use_direct_io() to ReadaheadRandomAccessFile 082493442 truncate patch 286a36db7 posix writablefile truncate f0879e4c3 Page size isn't always 4k on linux 18eeb7b90 Fix interference between max_total_wal_size and db_write_buffer_size checks 1560b2f5f Temporarly return deprecated functions to fix MongoRocks build 2a0f3d0de level compaction expansion ebc8a7998 alignment is on in ReadaheadRandomAccessFile::Read() 381fd3224 Remove timeout_hint_us from WriteOptions fce7a6e19 Fail IngestExternalFile when bg_error_ exists a618a16f4 New subcode for IOError to detect the ESTALE errno 7ab005183 Remove deprecated DB::AddFile and DB::CompactRange 401667366 Adding Dlang to the list 756c5924e Allow adding external v1 sst file with no global seqno support aa0298fa9 Remove trailing whitespace from examples Makefile db2b4eb50 avoid direct io in rocksdb_lite 43e9f01c2 Fix repair_test on ROCKSDB_LITE 7106a994f Use monotonic time points in write_controller.cc and rate_limiter.cc c2247dc1c Make DBImpl::has_unpersisted_data_ atomic eb912a927 Remove disableDataSync option 0227c16d6 Update static library versions and add checksums b3aae4d07 Add repair_test to make check 421ce7c2b Add support for JNI Library on Linux on PowerPC. 9afa20cf2 Increase build version and HISTORY.md for releasing 5.2 a5adda064 Fix repair issues b48e4778b Consolidate file cutting logic in compaction loop ac2a77a74 Announce the experimetnal two-level index feature in HISTORY.md c4a37dcb4 Print the missed last layer in cfstats a12818afc Blog post for 5.1.2 release 3b4ac8076 Clarify ldb column family argument d70ce7ee0 Move db_bench flags out of unnamed namespace 186c7eedb Remove incorrect statistics warning 53bb01516 [rocksdb][PR] compaction_style and compaction_pri should output their value as a st… 69d5262c8 Two-level Indexes 0a4cdde50 Windows thread 1aaa898cf Adding GetApproximateMemTableStats method 9fc23c55f Use gcc-4.9-glibc-2.20-fb python in precommit_checker b797e4215 Dump compression dictionary meta-block 036d668b1 Fix wrong result in data race case related to Get() 574b543f8 Rename merger.h -> merging_iterator.h add8b50cc Move ThreadLocal implementation into .cc 71d2496af Fix arc setting for Facebook internal tools f289d9f4a Fix OSX build break after the fallocate change 4a3e7d320 Change the default of delayed slowdown value to 16MB/s 0513e21f9 RangeSync() should work with ROCKSDB_FALLOCATE_PRESENT not set 8b369ae5b Cleaner default options using C++11 in-class init ec79a7b53 Dedup code in option.cc and db_options.cc b96372dea improving the C wrapper 04c4ec41d Change corruption_test to use 4 bits. 2d75cd40d NewLRUCache() to pick number of shard bits based on capacity if not given f25f1ec60 Add test DBTest2.GetRaceFlush which can expose a data race bug 37d4a79e9 Deserialize custom Statistics object in db_bench 3b35134e4 Avoid cache lookups for range deletion meta-block 94a0c32e7 Fix LRU Ref() for handles with external references only 17c118060 Generalize Env registration framework 07dddd5f7 EnvPosixTestWithParam should wait for all threads to finish 5dad9d6d2 Avoid logs_ operation out of DB mutex a7b13919b Fix CompactFiles() bug when used with CompactionFilter using SuperVersion 616a1464e Fix DeleteRange including sentinels in output files c918c4b76 Update USERS.md add user Pika 03ca2ac8a Remove function from DBImpl that are not used anywhere b0029bc7f Test merge op covered by range deletion in memtable d438e1ec1 Test range deletion block outlives table reader fba726e55 Version librocksdb.so 9da4d542f Range deletions unsupported in tailing iterator f2b4939da fixed typo 973f1b78f memtable: delete merge value for range deleteion aebfd1703 fix non-portable behavior in encoder 753ff84a3 Fix get approx size d7ea44f2f Fixup a couple of builds errors on Linux. 537da370d c: allow set savepoint to writebatch af6ec4d78 fix batchresult handle leak e29bb934f Zlib 1.2.8 is no longer available, switched to 1.2.10 5ac97314e Fix std::out_of_range when DBOptions::keep_log_file_num is zero 4e35ffdfa cmake: check -momit-leaf-frame-pointer before using it 3c0852d1d Make ingest external file backward compatible 0e8dfd606 Fix OptimizeForPointLookup() e840213d6 Change DB::GetApproximateSizes for more flexibility needed for MyRocks 9239103cd Flush job should release reference current version if sync log failed da54d36a9 Disable IngestExternalFile in ReadOnly mode 5cf176ca1 Fix for 2PC causing WAL to grow too large 4a73bb0b4 Split travis jobs c70d3c7ad Enable DBTest.GroupCommit as it runs in a reasonlable time now. 602c13a96 Remove fadvise with direct IO read f9d18e22d Fix DeleteRange file boundary correctness issue with max_compaction_bytes 3ce091fd7 Add KEEP_DB env var option 77b480662 Fix 2PC with concurrent memtable insert e8a096000 util/thread_local.h: silence a clang-build warning 324a0f988 Follow up for DirectIO refactor bc5d7b702 travis: For linux, do all tests under gcc 3e6899d11 change UseDirectIO() to use_direct_io() d4e07a845 fix warning of unused direct io helper functions dc2584eea direct reads refactor d18dd2c41 Abort compactions more reliably when closing DB 62384ebe9 Guarding extra fallocate call with TRAVIS because its not working pro… 9f246298e Performance: Iterate vector by reference fe395fb63 Allow incrementing refcount on cache handles 2172b660e Fix build on FreeBSD 3c233ca4e Fix Windows environment issues 763173456 Fix the error in ColumnFamiliesTest 7a02ad070 Update travis to ubuntu trusty 60c509ff1 Fix valgrind failure in test CurrentFileModifiedWhileCheckpointing2PC d0ba8ec8f Revert "PinnableSlice" 54d94e9c2 PinnableSlice e04480fae Fix MS warnings. Use ROCKSDB_Prsz for size_t. c081f7215 5.0.1 release blog post ac73d7558 Add GetSupportedCompressions() convenience function b104b8781 Maintain position in range deletions map 640d72480 Update db_bench and sst_dump to test with block cache mid-point inser? 653ac1f9c C API: support total_order_mode 85ac1a320 Fix rocksdb::Status::getState 76711b6e7 Make ExternalSSTFileTest::CompactionDeadlock more deterministic c963460db Fix tests under GCC_481 33c86d677 Fix backupable db test e425ec116 utilities/backupable: backup should limit the copy size of wal. 0712d541d Delegate Cleanables d58ef52ba Allow SstFileWriter to Fadvise the file away from page cache 17a4b75cc Always fsync the file after file copying 2fb70dc79 examples: Add options_file_example to target all a738af8f8 db/pinned_iterators_manager.h: bugfix 906523d98 Add description to the 2PC checkpooint bug in HISTORY.md 438f22bc5 Fix bug of Checkpoint loses recent transactions with 2PC 335981d47 Fix the directory path for RocksDB repo 548b62805 Enable conditionally using adaptive mutexes 4e07b08ef include/rocksdb/utilities/env_librados: fix typo ab48c165a Print cache options to info log 972f96b3f direct io write support 989e644ed Remove sst_file_manager option from LITE 1beef6569 Fix c_test 3d692822f persistent_cache: fix two timer 046099c9b The array is malloced by backtrace_symbols(), and must be freed 6ff2c8d7f Remove gflags as travis build dependency 3cd9ed1c3 Show sandcastle URL in phabricator 50e305de9 Collapse range deletions 5d1457dbb Dump persistent cache options 7bd725e96 db_bench: introduce --benchmark_read_rate_limit 296691847 Update Netflix section of USERS.md 342370f1d Simplify MemTable::Update 1a136c1f1 Expose file size fbff4628a Reduce compaction iterator status checks bd6cf7b51 WritableFileWriter: default buffer size equal min(64k,options.writabl? fc0c6fd98 "make format" format diff since last commit from master 816c1e30c gcc-7 requires include <functional> for std::function c27073586 Iterator should be in corrupted status if merge operator return false a8bf4d63f Make format shows wrong curl command for retrieving clang-format-diff.py 8f5d24ae6 C API: support get usage and pinned_usage for cache 0ab6fc167 Gcc-7 buffer size insufficient b7239bf7e Gcc 7 fallthrough 477b6ea57 std::remove_if requires <algorithm> 83f9a6fd2 Fail BackupEngine::Open upon meta-file read error a79eae4b0 Add pcache documentation images d71e728c7 Print user collected properties in sst_dump 7004a6f7b Add missing copyright header 3cdfaeca3 Fixes for MSVC compilation e097222e6 util/logging.cc: buffer of insufficient size (gcc-7 -Werror=format-length) cfc34d7c4 Missing break in case in DBTestBase::CurrentOptions bfbcec233 Gcc 7 error expansion to defined 6653e32ac build: make it easier to pass PORTABLE 67adc937b intentional fallthough (prevents gcc-7/clang-4 error) 1a146f89c break Flush wait for dropped CF c3e5ee715 util/histogram.cc: HistogramStat::toString buffer insufficient 5334d8b44 table/block_based_table_builder.cc: intentional fallthrough - comment to match gcc pattern 36d42e65d Disable test to unblock travis build b57dd9262 C API: support writebatch delete range 2ba59b5a1 Disallow ingesting files into dropped CFs 1f6f7e3e8 cast to signed char in ldb_cmd_test for ppc64le 243975d5d More accurate error status for BackupEngine::Open f0c509e2c Return finer-granularity status from Env::GetChildren* dc64f46b1 Add db_bench option for stderr logging 2cabdb8f4 Increase buffer size 4a17b47bb Remove unnecessary header include 8c2b921fd Fixed a crash in debug build in flush_job.cc 20ce081fa Fix issue where IngestExternalFile insert blocks in block cache with g_seqno=0 5241e0dbf fix db_bench argument type c04f6a0b4 Specify shell in makefile 45c7ce137 CompactRangeOptions C API 2c2ba6824 db_stress support for range deletions b821984d3 DeleteRange read path end-to-end tests 2f4fc539c Compaction::IsTrivialMove relaxing 1dce75b2e Update USERS.md 304b3c706 Update USERS.md fa50fffaf Option to expand range tombstones in db_bench c26a4d8e8 Fix compile error in trasaction_lock_mgr.cc ed8fbdb56 Add EventListener::OnExternalFileIngested() event 2005c88a7 Implement non-exclusive locks 0b0f23572 Mention IngestExternalFile changes in HISTORY.md 23db48e8d Update HISTORY.md for 5.0 branch beb36d9c1 Fixed CompactionFilter::Decision::kRemoveAndSkipUntil 67f37cf19 Allow user to specify a CF for SST files generated by SstFileWriter 9053fe2a5 Made delete_obsolete_files_period_micros option dynamic edde954e7 fix clang build 56281f3a9 Add memtable_insert_with_hint_prefix_size option to db_bench 4a21b1402 Cache heap::downheap() root comparison (optimize heap cmp call) e39d08087 Fix travis (compile for clang < 3.9) 3f407b065 Kill flashcache code in RocksDB b77007df8 Bug: paralle_group status updated in WriteThread::CompleteParallelWorker 247d0979a Support for range skips in compaction filter 96fcefbf1 c api: expose option for dynamic level size target 00197cff3 Add C API to set base_backgroud_compactions 5b219eccb deleterange end-to-end test improvements for lite/robustness aad119176 pass rocksdb oncall to mysql_mtr_filter otherwise tasks get created w… e33352899 DeleteRange write path end-to-end tests 7784980fc Fix mis-reporting of compaction read bytes to the base level 3c6b49ed6 Fix implicit conversion between int64_t to int b3b875657 Remove unused assignment in db/db_iter.cc 4f6e89b1d Fix range deletion covering key in same SST file a2bf265a3 Avoid intentional overflow in GetL0ThresholdSpeedupCompaction 52fd1ff2c disable UBSAN for functions with intentional -ve shift / overflow 1886c435b Fix CompactionJob::Install division by zero 63c30de80 fix options_test ubsan 13e66a8f5 Fix compaction_job.cc division by zero 01eabf737 Fix double-counted deletion stat 7ffb10fc1 DeleteRange compaction statistics 236d4c67e Less linear search in DBIter::Seek() when keys are overwritten a lot cd7c4143d Improve Write Stalling System dfb6fe675 Unified InlineSkipList::Insert algorithm with hinting 3068870cc Making persistent cache more resilient to filesystem failures 734e4acaf Eliminate redundant cache lookup with range deletion 182b940e7 Add WriteOptions.no_slowdown 4118e1333 Persistent Cache: Expose stats to user via public API f2a8f92a1 rocks_lua_compaction_filter: add unused attribute to a variable 4444256ab Remove use of deprecated LZ4 function 548d7fb26 Fix fd leak when using direct IOs fd43ee09d Range deletion microoptimizations 23a18ca5a Reword support a little bit to more clear and concise 481856ac4 Update support to separate code issues with general questions a0deec960 Fix deadlock when calling getMergedHistogram fe349db57 Remove Arena in RangeDelAggregator e63350e72 Use more efficient hash map for deadlock detection a13bde39e Skip ldb test in Travis 73843aa63 Direct I/O Reads Handle the last sector correctly. 9d60151b0 Implement PositionedAppend for PosixWritableFile 3f6221521 Lazily initialize RangeDelAggregator's map and pinning manager 41e77b839 cmake: s/STEQUAL/STREQUAL/ c1038d283 Release RocksDB 5.0 635a7bd1a refactor TableCache Get/NewIterator for single exit points f39452e81 Fix heap use after free ASAN/Valgrind a4eb7387b Allow plain table to store index on file with bloom filter disabled 36e4762ce Remove Ticker::SEQUENCE_NUMBER 86eb2b9ad Fix src.mk 0765babe1 Remove LATEST_BACKUP file 647eafdc2 Introduce Lua Extension: RocksLuaCompactionFilter 760ef68a6 fix deleterange asan issue 327085b7b fix valgrind 715591bba Ask travis to use JDK 7 972e3ff29 Enable allow_concurrent_memtable_write and enable_write_thread_adaptive_yield by default 420bdb42e option_change_migration_test: force full compaction when needed 1543d5d92 Report memory usage by memtable insert hints map. 018bb2ebf DeleteRange support for db_bench dc51bd716 CMakeLists.txt: FreeBSD has jemalloc as default malloc 48e8baebc Decouple data iterator and range deletion iterator in TableCache 4b0aa3c4c Fix failed compaction_filter_example and add it into make all 53b693f5f ldb support for range delete 661e4c926 DeleteRange unsupported in non-block-based tables 489d14280 DeleteRange interface eba99c28e Fix min_write_buffer_number_to_merge = 0 bug 2ef92fea5 Remove all instances of relative_url until GitHub pages problem is fixed. 91300d01f Dynamic max_total_wal_size option ec2f64794 Consider subcompaction boundaries when updating file boundaries for range deletion 800e51553 Fix CSS issues again b952c898b Parallize persistent_cache_test and transaction_test 3b192f618 Handle full final subcompaction output file with range deletions 6c5795200 Make range deletion inclusive-exclusive 425210cc4 CSS issues are arising on the Github Pages side. Temp fix. 1ea79a78c Optimize sequential insert into memtable - Part 1: Interface df5eeb85c Optimize sequential insert into memtable - Part 2: Implementation 5ed650857 Fix SstFileWriter destructor adb665e0b Allowed delayed_write_rate option to be dynamically set. 307a4e80c sst_dump support for range deletion 361010d44 Exporting compaction stats in the form of a map 672300f47 Use relative Urls for stylesheets b39b2ee12 do not call get() in recovery mode 1ca5f6d13 Fix 2PC Recovery SeqId Miscount e095d0cbc Rocksdb contruns to new Sandcastle API 14c0380e7 Convenience option to parse an internal key on command line c90fef88b fix open failure with empty wal 4e20c5da2 Store internal keys in TombstoneMap a9fb346e4 Fix RocksDB Lite build failure in c_test.cc d133b08f6 Use correct sequence number when creating memtable 144cdb8f1 16384 as e.g .value for compression_max_dict_bytes 9bd191d2f Fix deadlock between (WriterThread/Compaction/IngestExternalFile) a9fae0a9d CSS problems again :( 193221e0a Fix Forward Iterator Seek()/SeekToFirst() e48f3f8b9 remove tabs and duplicate #include in c api 85bd8f518 Minor fix to GFLAGS usage in persistent cache a7875272d c: support seek_for_prev 0f17f9279 Make the header links a bit more flexible cf19f559d single quotes in feed 2dc019e09 Fix header links f1aedda06 More Jekyll 3.3 fixes c54cdc378 More Jekyll 3.3 updates 2bcaf8246 Update product and feature template for Jekyll 3.3 24bceb096 Java API - Implement GetFromBatch and GetFromBatchAndDB in WBWI 815f54afa Insert range deletion meta-block into block cache 9e7cf3469 DeleteRange user iterator support 5c5d01ae7 Fix wrong comment (Maximum supported block size) f998c9790 DeleteRange Get support 879f36636 Add C api for RateLimiter 557034f36 Remove all instances of baseurl 437942e48 Add avoid_flush_during_shutdown DB option 2b16d664c Change max_bytes_for_level_multiplier to double 16fb04434 expose IngestExternalFile to c abi ce22ea99a Fix casts for MSVC 196af035c Introduce FAIL_ON_WARNINGS CMake variable (default ON) 40a2e406f DeleteRange flush support d5555d95a Fix MSVC compile error in 32 bit compilation da61f348d Print compression and Fast CRC support info as Header level f9eb56791 db_bench: --dump_malloc_stats takes no effect 6a4faee5c fix freebsd build include path err and so & jar file name c90c48d3c Show More DB Stats in info logs 1b295ac8a DBTest.GetThreadStatus: Wait for test results for longer 25f5742f0 Update documentation to point at gcc 4.8 b50a81a2b Add a test for tailing_iterator 04751d534 L0 compression should follow options.compression_per_level if not empty 2946cadc4 Improve RangeDelAggregator documentation 0a9fd05c2 Update Vagrant file (test internal phabricator workflow) fcd1e0bf6 Make rocksdb work with internal repo 0aab5e55f FreeBSD: malloc_usable_size is in <malloc_np.h> (#1428) 9c0bb7f17 cmake: drop "-march=native" from CXX_FLAGS (#1429) eeb27e1bb Add handy option to turn on direct I/O in db_bench (#1424) c6168d13a removed some declarations from c.h which resulted in undefined symbols (#1407) bc429de49 revert fractional cascading in farward iterator b9bc7a2aa Use skiplist rep for range tombstone memtable 60a2bbba9 Makefile: generate util/build_version.cc from .in file (#1384) 9ee84067f Disable DBTest.RepeatedWritesToSameKey (#1420) f41df3045 OptionChangeMigration() to support FIFO compaction 2e8004e60 Changing the legocastle run to use valgrind_test instead of _check 9de2f7521 revert Prev() in MergingIterator to use previous code in non-prefix-seek mode 24495186d DBSSTTest.RateLimitedDelete: not to use real clock 1168cb810 Fix a bug that may cause a deleted row to appear again 99c052a34 Fix integer overflow in GetL0ThresholdSpeedupCompaction (#1378) f83cd64c0 Fix a bug that mistakenly disable regression_test.sh to update commit (#1415) 0e926b84f Passing DISABLE_JEMALLOC=1 to valgrind_check if run locally 4dfaa6610 Make IsDeadlockDetect() virtual member of Transaction 59a7c0337 Change ioptions to store user_comparator, fix bug 869ae5d78 Support IngestExternalFile (remove AddFile restrictions) 1d9dbef64 Restrict running condition of UniversalCompactionTrivialMoveTest2 4edd39fda Implement deadlock detection 48fd619a4 Minor fixes to RocksJava Native Library initialization (#1287) 48e4e842b Disable auto compactions in memory_test and re-enable the test (#1408) fb2e41294 column_family_test: disable some tests in LITE 5af651db2 fix data race in compact_files_test a0ba0aa87 Fix uninitialized variable gcc error for MyRocks b88f8e87c Support SST files with Global sequence numbers [reland] 08616b493 [db_bench] add filldeterministic (Universal+level compaction) 52c9808c3 not split file in compaciton on level 0 5e0d6b4cc fix db_stress assertion failure ab5399837 Bump RocksDB version to 4.13 (#1405) b4d07123c SamePrefixTest.InDomainTest to clear the test directory before testing aa09d0338 Avoid calling GetDBOptions() inside GetFromBatchAndDB() 6fbe96baf Compaction Support for Range Deletion 257de78d9 Remove "-Xcheck:jni" from Java tests (#1402) d88dff4ef add seeforprev in history 5027dd17a Fix a minor bug in the ldb tool that was not selecting the specified (#1399) fea6fdd67 Fix @see in two Java functions (#1396) b1031d6c1 Remove function local statics that interfere with memory pooling (#1392) f47054015 Handle WAL deletion when using avoid_flush_during_recovery e29d3b67c Make max_background_compactions and base_background_compactions dynamic changeable 21e8daced fix assertion failure in Prev() b9311aa65 Implement WinRandomRW file and improve code reuse (#1388) a249a0b75 check_format_compatible.sh to use some branch which allows to run with GCC 4.8 (#1393) 040328a30 Remove an assertion for single-delete in MergeHelper::MergeUntil 8cbe3e10c Relax the acceptable bias RateLimiterTest::Rate test be 25% f26a139d8 Log successful AddFile 5691a1d8a Fix compaction conflict with running compaction 017de666c fixup commit 1b7af5fb1 Redo handling of recycled logs in full purge 27bfe327b Editorial change to README.md 89cc404de A bit of doc restructuring 9e7fda829 Fix arcanist 2e4b5cab0 Add missing RateLimiter class to the Windows build (#1382) ce4963fdf [doc] Document that Visual Studio 2015+ is now required for Windows builds (#1389) e48927098 Fix scoped arena iterator (#1387) f8d8cf53f Fix log_write_bench -bytes_per_sync option. (#1375) 02b3e3985 Make txn->GetState() const 447f17127 new Prev() prefix support using SeekForPrev() 991b585ee More block cache tickers d6ae6dec6 Add Statistics::getAndResetTickerCount(). aea3ce4c8 Avoid string CONCAT which is not supported in cmake 2.6 (#1383) 2ad68b971 Support running consistency checks in release mode 67501cfc9 Fix -ve std::string::resize 04b02dd12 Testing asset links after config change 8c55bb87c Make Lock Info test multiple column families d06232897 Revert "Support SST files with Global sequence numbers" 5cd28833a [RocksJava] Adjusted RateLimiter to 3.10.0 (#1368) 37737c3a6 Expose Transaction State Publicly 2c1f95291 Add facility to write only a portion of WriteBatch to WAL 043cb62d6 Fix record_size in log_write_bench, swap args to std::string::assign. (#1373) 4985f60fc env_mirror: fix a few leaks (#1363) 5aded67dd update of c.h (#1371) 912aec13c "Recent Posts" -> "All Posts" 7cbb298db Make sure that when contribtuing we call out creating appropriate directories a06ad4711 Add top level doc information to CONTRIBUTING.md 3fdd5b971 A little more generic CONTRIBUTING.md ed4fc31db Add link to CONTRIBUTING.md to main docs README.md e4922e181 Forgot to truncate one blog post 6d8cd7ede Add CONTRIBUTING.md for rocksdb.org contribution guidance bd55e5a1e Fix some formatting of compaction blog post 0f60358b0 CRLF -> LF mod (including removing trailing whitespace for those files) b90e29c90 Truncate posts on the main /blog/ page 0d7acadaf Add author fields to blog posts 01be44181 Add GitHub link to the landing page header 9d6c96138 Fix Mac build ab01da543 Support SST files with Global sequence numbers d346ba246 Minor fixes around Windows 64 Java Artifacts (#1366) e91b4d0cf Add factory method for creating persistent cache that is accessible from public be1f1092c Expose transaction id, lock state information and transaction wait information 6009c473c Store range tombstones in memtable 3c21c64c7 Use size hint for HashMap in multiGet. Similar to https://github.com/facebook/rocksdb/pull/1344 (#1367) 13f7a01f6 Fixing JNI release build for gcc (#975) 7260662b3 Add Java API for SstFileWriter 26388247a delete unused variable for PrevInterval() 87dfc1d23 Fix conflict between AddFile() and CompactRange() eb44ed655 Update 2016-09-28-rocksdb-4-11-2-released.markdown e4437610d Update 2016-09-28-rocksdb-4-11-2-released.markdown 501f05108 Update 2016-09-28-rocksdb-4-11-2-released.markdown dec9009f8 Update 2016-09-28-rocksdb-4-11-2-released.markdown 4ed69dd0b Create 2016-09-28-rocksdb-4-11-2-released.markdown 21f4bb5a8 cmake support for linux and osx (#1358) 4defe306f fix typo in comments (#1360) f517d9dd0 Add SeekForPrev() to Iterator eb3894cf4 Recompute compaction score on SetOptions (#1346) 5c64fb67d Fix AddFile() conflict with compaction output [WaitForAddFile()] 9e9f5a0b9 Fix CompactFilesTest.ObsoleteFiles timeout (#1353) c2a62a4cb not cut compaction output when compact to level 0 9ed928e7a Split DBOptions into ImmutableDBOptions and MutableDBOptions 4bc8c88e6 Recover same sequence id from WAL (#1350) 0a1bd9c50 add cfh deletion started listener da5a9a65c Fix mac build d45eb6c6d Fix typo (#1349) abc0ae462 Add AddFile() InternalStats for Total files/L0 files/total keys ingested 715256338 forbid merge during recovery 5735b3dc2 Fix compiling under -Werror=missing-field-initializers 654ed9a28 loose the assertion condition of rate_limiter_test e4d3f5d9b Fix DBImpl::GetWalPreallocateBlockSize Mac build error 7afbb7420 solve the problem of table_factory_to_write_=nullptr (#1342) d78a4401b DBImpl::GetWalPreallocateBlockSize() should return size_t 42ac9c5f1 Retry getting arcanist token on failure b666f8544 Consider more factors when determining preallocation size of WAL files 4c3f4496b Add TableBuilderOptions::level and relevant changes (#1335) 3edb9461b Avoid hard-coded sleep in EnvPosixTestWithParam.TwoPools 0a88f38b7 Remove ColumnFamilyData::options() 41a9070f8 Fix java makefile dependencies 8d9bf5c49 Fix DBOptionsTest.GetLatestOptions 40cfa3e02 Fix DBWALTest.RecoveryWithLogDataForSomeCFs with mac 06b4785fe Fix recovery for WALs without data for all CFs d7242ff4d Fix GetSortedWalFiles when log recycling enabled 17f76fc56 DB::GetOptions() reflect dynamic changed options 215d12826 Fix typo (#903) a958c2643 Rename jvalue to jval in rocksjni 0a165bd7d Have Facebook link point to RocksDB on FB 3639f3288 Fix bug in UnScSigned-off-by: xh931076284 <931076284@qq.com> (#1336) 8e061f974 Refactor GetMutableOptionsFromStrings 81747f1be Refactor MutableCFOptions ba65c816b Support POSIX RandomRWFile 1d980a8e3 Create CNAME 2adab1dde Add API links to the header bar a182b2981 Preserve blog comments in markdown f54de9230 Adding Dgraph to list of Users (#1291) 9e4aa798c Summary: (#1313) a10e8a056 Fix C api memtable rep bugs. (#1328) eb1d4d53c Release RocksDB 4.12 22d88e24d Allow an offset as well as a length to be specified for byte[] operations in RocksJava JNI (#1264) b06b19136 add C api for set wal_recovery_mode (#1327) 1cca09129 Temporarily revert Prev() prefix support de28a2553 Update HISTORY.md for thread-local stats 0fcb6dbed Remove extraneous function prototypes from c.h (#1326) 52ee07b02 Move AddFile() tests to external_sst_file_test.cc 66a91e260 Add NoSpace subcode to IOError (#1320) 67036c040 Fix Flaky ColumnFamilyTest.FlushCloseWALFiles 0e2da497c fix typo in option.h's comment (#1321) 6d61358a0 Add real Google Analytics ID 2d9d36ea4 Have "Edit on GitHub" point to master instead of gh-pages 937751898 Update landing page content 1ec75ee76 Add redirects from old blog posts link to new format 607628d34 Support ZSTD with finalized format ce1be2ce3 Fix build error on Windows (AppVeyor) (#1315) f7669b40b Fix Windows Build 22696b088 Fix uninitlized CompactionJob::SubcompactionState::current_output_file_size c1865e0f7 Trigger more tests per diff a88677d2c Remove ImmutableCFOptions from public API 80c75593e Fix data race in AddFile() with multiple files + custom comparator bug 5051755e3 Fix db_bench memory use after free (detected by clang_analyze) 4fd08f4b8 Ensure Correct Behavior of StatsLevel kExceptDetailedTimers and kExceptTimeForMutex (#1308) e14fbaae2 Add FAQ based on the front page of the current rocksdb.org 3c2262400 Migrate the RocksDB Worpdress blog over to Jekyll ee0e2201e Transfer the current Getting Started contents to GitHub Pages 5a0e9a4cf Initial Landing Page 9447a8540 Remove the `doc` directory 32149059f Merge options source_compaction_factor, max_grandparent_overlap_bytes and expanded_compaction_factor into max_compaction_bytes 4590b53a4 add stats to Cache::LookUp() 85bb30825 Expose Utility function StringToMap() (#1306) 8ce1b8440 Fix Travis on Mac 380e651af Fix Mac build failure (#1309) 1613fa949 Thread-specific histogram statistics 6a14d55bd add prefix_seek_mode to db_iter_test de47e2bd4 Fix ClockCache memory leak f099af4c7 Fix travis db74b1a21 fix bug in merge_iterator when data race happens b18f9c9ea add nullptr check to internal_prefix_transform 4e395e875 Update docs README.md 2482d5fb4 support Prev() in prefix seek mode 7541c7a79 Fix cache_test valgrind_check failure c8513cde0 Update the download location of Snappy (#1304) b49b92cf2 Introduce Read amplification bitmap (read amp statistics) c7004840d store prefix_extractor_name in table 4ad928e17 add comment to SimCache to estimate actual capacity e9b2af87f Expose ThreadPool under include/rocksdb/threadpool.h 23a057007 Document memtable flush behavior in CancelAllBackgroundWork() dade61ac2 Mitigate regression bug of options.max_successive_merges hit during DB Recovery cce702a6e [db_bench] Support single benchmark arguments (Repeat for X times, Warm up for X times), Support CombinedStats (AVG / MEDIAN) 3586901f8 cat tests logs sorted by exit code b2ce59537 Persist data during user initiated shutdown 4b3438d2d Fix parallel valgrind (valgrind_check) a081f798b Relax consistency for thread-local ticker stats b10d65c2a Update and slightly clarify instructions in build_detect_platform (#1301) f85f99bf6 Fix the Windows build of RocksDB Java. Similar to https://github.com/facebook/rocksdb/issues/1220 (#1284) 7b8109517 Fix a crash when compaction fails to open a file 7c9586837 Thread-specific ticker statistics ea9e0757f Add initial GitHub pages infra for RocksDB documentation move and update. (#1294) 2a9c97108 [Flaky Test] Disable DBPropertiesTest.GetProperty d76ddf327 Disable ClockCache db_crashtest cec2c6436 fix data race in NewIndexIterator() in block_based_table_reader.cc badbff65b Not insert into block cache if cache is full and not holding handle 4a16c32ec Option to cache index/filter blocks with priority 99c4af716 Make ClockCache available with TSAN build f57bc1d03 Fix lambda expression for clang/windows 5440675c3 Fix lambda capture expression for windows 6584cec8f Fold function for thread-local data 817eeb29b Add singleDelete to RocksJava (#1275) ffdf6eee1 Add Status to RocksDBException so that meaningful function result Status from the C++ API isn't lost (#1273) ecf900386 Fix bug in printing values for block-based table 72f8cc703 LRU cache mid-point insertion 6a17b07ca Add TablePropertiesCollector support in SstFileWriter 78837f5d6 TableBuilder / TableReader support for range deletion 4cc37f59e Introduce ClockCache ff17a2abf Adding TBB as dependency. 49d88be02 c abi: allow compaction filter ignore snapshot (#1268) 0b63f51fb fixes 1215: execute_process(COMMAND mkdir ${DIR}) fails to create a directory with cmake on Windows (#1219) 3981345be Small nits (#1280) 2a2ebb6f5 Move LRUCache structs to lru_cache.h header 2fc2fd92a Single Delete Mismatch and Fallthrough statistics 3771e3797 WriteBatch support for range deletion 236756f2c Make SyncPoint return immediately when disabled 64a0082c6 Fix DBSSTest::AddExternalSstFileSkipSnapshot valgrind fail dd7a748cf Fix java build 4fe12baa6 Make db_bench less space for --stats_per_interval 6525ce4ca Compaction stats printing: "batch" => "commit group" a117891b4 Fixed typo (#1279) b248e98cf Fix a destruction order issue in ThreadStatusUpdater deda159b5 Added min/max/avg data block size output to sst_dump e408e98c8 add Name() to Cache a297643f2 Fix valgrind memory leak d11c09d9e Eliminate memcpy from ForwardIterator d36755502 Added further Java API options for controlling concurrent writes ebdfe34cc Exposed further Java API options for controlling compaction d1be59463 Improve documentation of SliceTransform. 6056d6317 Improve comment and bug fix for GetOptionsFromMap functions in convenience.h 76a67cf74 support stackableDB as the baseDB of transactionDB 67c1ae883 Travis build break fix b693ba68b Minor PinnedIteratorsManager Refactoring db3dfb164 Fixes for arcanist config (#1271) 87c91bd87 Persistent Read Cache (8) Benchmark tooling 2914de64e add sim_cache stats to Statistics 8b79422b5 [Proof-Of-Concept] RocksDB Blob Storage with a blob log file. 4beffe001 Fix test data race in two FaultInjectionTest tests 821bcb0b3 util/arena.cc: FreeBSD: More portable use of mmap(MAP_ANON) (#1254) 5370f44a8 Increase RocksDB version 56dd03411 read_options.background_purge_on_iterator_cleanup to cover forward iterator and log file closing too. ccecf3f4f UniversalCompaction should ignore sorted runs being compacted (when compacting for file num) 1b0069ce2 Remove non-gtest from parallelized tests 638c49f24 Change HISTORY.md for release 4.11 6b8e9c68b fix vs generator (#1269) c38b075e7 Update HISTORY.md 8f399e3fe Update HISTORY.md 98d0b78ea Added check_snapshot option in the DB's AddFile function (#1261) 9fd68b7fb set travis open file descriptor limit 59ddb5059 Fix travis build break f4d986364 Added SetOptions support to RocksJava (#1243) 7882cb977 Make DBOptionsTest::EnableAutoCompactionAndTriggerStall less falky 44f5cc57a Add time series database (resubmitted) 7c4615cf1 A utility function to help users migrate DB after options change 5bb0a7f73 Update appveyor.…
aead40417 fix HISTORY.md typo a0cdc3cec Bump version to 5.8.7 7513f6350 Fix IOError on WAL write doesn't propagate to write group follower 9e47084ce Bump version to 5.8.6 36074ba5d Enable cacheline_aligned_alloc() to allocate from jemalloc if enabled. aa00523e0 Add -DPORTABLE=1 to MSVC CI build cf2b98237 Bump version to 5.8.5 e8c9350f2 Blob DB: not using PinnableSlice move assignment 4907d2463 Bump version to 5.8.4 5d928c795 Blob DB: Fix race condition between flush and write 725bb9d66 Blob DB: Fix release build b7367fe84 Bump version to 5.8.3 13b2a9b6f Blob DB: use compression in file header instead of global options 5dc70a15c Fix PinnableSlice move assignment 9019e9125 dynamically change current memtable size 7f1815c37 Bump version to 5.8.2 2584a18ef Blob DB: Fix BlobDBTest::SnapshotAndGarbageCollection asan failure 17f67b546 PinnableSlice move assignment 6fb56c582 Blob DB: Add compaction filter to remove expired blob index entries f90ced92f Blob DB: fix snapshot handling 632f36dcd Blob DB: option to enable garbage collection 11bacd578 Blob DB: Fix flaky BlobDBTest::GCExpiredKeyWhileOverwriting test f98efcb1e Blob DB: Evict oldest blob file when close to blob db size limit c1e99eddc Blob DB: cleanup unused options ffc3c62ca Blob DB: Initialize all fields in Blob Header, Footer and Record structs 9e8254090 Blob DB: update blob file format d66bb21e1 Blob DB: Inline small values in base DB 05d5c575a Return write error on reaching blob dir size limit 2b8893b9e Blob DB: Store blob index as kTypeBlobIndex in base db 419b93c56 Blob DB: not writing sequence number as blob record footer 8afb0036c fix lite build dded348dd Blob DB: Move BlobFile definition to a separate file 374736123 add GetLiveFiles and GetLiveFilesMetaData for BlobDB 8cff6e945 Enable WAL for blob index c29347290 Add ValueType::kTypeBlobIndex eae53de3b Make it explicit blob db doesn't support CF 65aec19df Fix memory leak on blob db open 30b38c98c TableProperty::oldest_key_time defaults to 0 2879f4beb Bump version to 5.8.1 88595c882 Add DB::Properties::kEstimateOldestKeyTime 266ac245a Bumping version to 5.8 64185c23a update HISTORY.md for DeleteRange bug fix e83d6a02e Not using aligned_alloc with gcc4 + asan 0980dc6c9 Fix wrong smallest key of delete range tombstones b76797231 avoid use-after-move error c41744270 CMake: Fix formatting c21ea8f7a CMake: Add support for CMake packages 544434558 add Erlang to the list of language bindings 2972a702a Minor updates to FlushWAL blog fbfa3e7a4 WriteAtPrepare: Efficient read from snapshot list b01f426f5 Blog post for FlushWAL 503db684f make blob file close synchronous 3c840d1a6 Allow DB reopen with reduced options.num_levels 92bfd6c50 Fix DropColumnFamily data race 7fdf735d5 Pinnableslice examples and blog post 7fbb9ecca support disabling checksum in block-based table 19cc66dc4 fix clang bug in block-based table reader 7eba54eb9 test compaction input-level split range tombstone assumption cd26af347 Add unit test for WritePrepared skeleton a12479819 Improved transactions support in C API c10b39131 LANGUAGE-BINDINGS.md: add another rust binding 90177432e Remove leftover references to phutil_module_cache 234f33a3f allow nullptr Slice only as sentinel ccf7f833e Use PinnableSlice in Transactions 1dfcdb15f Extend pin_l0 to filter partitions 39ef90055 stop calling memcmp with nullptrs 78cb6b611 Provide byte[] version of SstFileWriter.merge to reduce GC Stall 867fe92e5 Scale histogram bucket size by constant factor f004307e9 CMake improvements 09ac6206a Circumvent ASAN false positive 5b68b114f Blob db create a snapshot before every read 4624ae52c GC the oldest file when out of space 8ace1f79b add counter for deletion dropping optimization 0d8e992b4 Revert the mistake in version update 5358a8056 add VerifyChecksum to HISTORY.md ed0a4c93e perf_context measure user bytes read 1efc600dd Preload l0 index partitions bddd5d363 Added mechanism to track deadlock chain c1384a707 fix db_stress uint64_t to int32 cast 29877ec7b Fix blob db crash during calculating write amp 8f2598ac9 Enable Cassandra merge operator to be called with a single merge operand 9a44b4c32 Allow merge operator to be called even with a single operand ac8fb77af fix some misspellings 23593171c minor improvements to db_stress af012c0f8 fix deleterange with memtable prefix bloom 1c8dbe2aa update scores after picking universal compaction eb6425303 Update WritePrepared with the pseudo code 132306fbf Remove PartialMerge implementation from Cassandra merge operator 71598cdc7 Fix false removal of tombstone issue in FIFO and kCompactionStyleNone 3204a4f64 Fix missing stdlib include required for abort() 7aa96db7a db_stress rolling active window dfa6c23c4 Update RocksDBCommonHelper to use escapeshellarg e367774d1 Overload new[] to properly align LRUCacheShard ad42d2fcb Remove residual arcanist_util directory 279296f4d properly set C[XX]FLAGS during CMake configure-time checks c5f0c6cc6 compile with correct flags to determine SSE4.2 support 185ade4c0 cmake: support more compression type 5449c0990 rocksdb: make buildable on aarch64 a144a9782 Fix for CMakeLists.txt on Windows for RocksJava acf935e40 fix deletion dropping in intra-L0 8254e9b57 make sst_dump compression size command consistent 74f18c130 db_bench support for non-uniform column family ops 5de98f2d5 approximate histogram stats to save cpu 3f5888430 Fix c_test ASAN failure e5a1b727c Fix blob DB transaction usage while GC 6f051e0c7 fix corruption_test valgrind ac098a462 expose set_skip_stats_update_on_db_open to C bindings 666a005f9 Support prefetch last 512KB with direct I/O in block based file reader ad77ee0ea Revert "Makefile: correct faligned-new test" b87ee6f77 Use more keys per lock in daily TSAN crash test 25df24254 Add column families related functions (C API) 64f848435 block_cache_tier: fix gcc-7 warnings 0cecf8155 Write batch for `TransactionDB` in C API 6a9de4347 Windows.h macro call fix 23c7d1354 fix comment 1fbad84b6 Makefile: correct faligned-new test 7848f0b24 add VerifyChecksum() to db.h 47ed3bfc3 fix WinEnv assertions d97a72d63 Try to repair db with wal_dir option, avoid leak some WAL files 36375de76 gcc-7/i386: markup intentional fallthroughs bdc056f8a Refactor PessimisticTransaction a9a4e89c3 Fix valgrind complaint about initialization 4ca11b4b0 Update USERS.md c9804e007 Refactor TransactionDBImpl 20dc5e74f Optimize range-delete aggregator call in merge helper. 0d4a2b733 Avoid blob db call Sync() while writing 627c9f1ab Don't add -ljemalloc when DISABLE_JEMALLOC is set dce6d5a83 db_bench background work thread pool size arguments 4f81ab38b Makefile: fix for GCC 7+ and clang 4+ 92afe830f Update all blob db TTL and timestamps to uint64_t 5883a1ae2 Fix /bin/bash shebangs cc01985db Introduce bottom-pri thread pool for large universal compactions 0b814ba92 Allow concurrent writes to blob db 2c45ada4c Blob DB garbage collection should keep keys with newer version 58410aee4 Fix the overflow bug in AwaitState c3d5c4d38 Refactor TransactionImpl 060ccd4f8 support multiple CFs with OPTIONS file 345387067 Fix statistics in RocksJava sample 1900771bd Dump Blob DB options to info log 3218edc57 Fix universal compaction bug 6a36b3a7b fix db get/write stats a84cee812 Add a missing "once" in .h 21696ba50 Replace dynamic_cast<> e85f2c64c Prevent empty memtables from using a lot of memory ac748c57e Fix FIFO Compaction with TTL tests aaf42fe77 Move blob_db/ttl_extractor.h into blob_db/blob_db.h aace46516 Fix license headers in Cassandra related files 50a969131 CacheActivityLogger, component to log cache activity into a file 6083bc79f Blob DB TTL extractor 710411aea fix asan/valgrind for TableCache cleanup 3a3fb00b7 TARGETS file not setting sse explicitly fca4d6da1 Build fewer tests in Travis platform_dependent tests 8f553d3c5 remove unnecessary internal_comparator param in newIterator 7f6d012d7 "ccache -C" in Travis d12691b86 move TableCache::EraseHandle outside of db mutex f33f11368 fix db_bench argument type e7697b8ce Fix LITE unit tests 3ce20e985 Fix use of RocksDBCommonHelper in cont_integration.sh c281b4482 Revert "CRC32 Power Optimization Changes" 9980de262 Fix FIFO compaction picker test 2289d3811 CRC32 Power Optimization Changes 30b58cf71 Remove the orphan assert on !need_log_sync fe1a5559f Fix flaky write_callback_test addbd279c 5.6.1 release blog post 30edff308 buckification: remove explicit `-msse*` compiler flags 2b259c9d4 Lower num of iterations in DeadlockCycle test 277f6f23d Release note for partitioned index/filters 5e731a138 Remove unused rocksdb arcanist lib 9b11d4345 Fix broken links 06f191744 add vcpkg as an windows option ea8ad4f67 Fix compaction div by zero logging 34112aeff Added db paths to c 1d8aa2961 Gcc 7 ParsedInternalKey replace memset with clear function. a4c42e800 Fix UBSAN issue of passing nullptr to memcmp 16e038820 LRUCacheShard cache line size alignment 216644c61 enable UBSAN macro in TARGETS e67b35c07 Add Iterator::Refresh() a34b2e388 Fix caching of compaction picker's next index 72502cf22 Revert "comment out unused parameters" 1d7048c59 comment out unused parameters 534c255c7 Cassandra compaction filter for purge expired columns and rows 63163a8c6 Remove make_new_version.sh 0302da47a Reduce blob db noisy logging 3e5ea29a8 Fix Flaky DeleteSchedulerTest::ImmediateDeleteOn25PercDBSize a22b9cc6f overlapping endpoint fixes in level compaction picker ffd2a2eef delete ExpandInputsToCleanCut failure log 3e6e863b1 Remove arcanist_util directory 36651d14e Moving static AdaptationContext to outside function 6e3ee015f Update java/rocksjni.pom ecff9d5e3 Include write_buffer_manager in ImmutableDBOptions::Dump ae28634e9 Remove some left-over BSD headers 33b1de82a Remove format compatibility hack 2f375154e checkout local branch in check_format_compatible.sh ddb22ac59 avoid collision with master branch in check format 0c03a7f17 set the remote for git checkout 7ac184c6d Revert cmake -DNDEBUG for non-MSVC 0655b5858 enable PinnableSlice for RowCache 00464a314 Fix column_family_test with LITE build b2dd192fe tools/write_stress.cc: Correct "1204" typos. cbaab3044 table/block.h: change memset f1a056e00 CodeMod: Prefer ADD_FAILURE() over EXPECT_TRUE(false), et cetera 4a2e4891f Add back the LevelDB license file a7321fc97 Remove the licensing description in CONTRIBUTING.md 3c327ac2d Change RocksDB License 132013366 Make TARGETS file portable ccf5f08f8 Set CACHE_LINE_SIZE for s390, PPC, ARM64 67510eeff db_crashtest.py: remove need for shell 4267eb00d Remove punit tests 5bfb67d90 Enable write rate limit for updaterandom benchmark 20a691d98 Update HISTORY to release 5.7 98d1a5510 db_bench to by default verify checksum 26ce69b19 Update blob db to use ROCKS_LOG_* macro 43e4eef77 remove unnecessary fadvise 21b17d768 Fix BlobDB::Get which only get out the value offset 70440f7a6 Add virtual func IsDeleteRangeSupported 7550255c5 Add JAVAC_ARGS as Makefile variable 7a0b5de77 Gcc 7 ignored quantifiers 000bf0af3 Improve the design and native object management of Stats in RocksJava 269d383d5 Bump version to 5.7 c32f27223 Fixes db_bench with blob db fcd99d27c db_bench_tool: fix buffer size 87128bd5c fix regression test 8f927e5f7 Fix undefined behavior in Hash 643b787c7 Added a note about LZ4 compression dependency 56656e12d Temporarily disable FIFOCompactionWithTTLTest b5fb85ec5 fix valgrind init complaint 657df29ea Add max_background_jobs to db_bench a43c053ad remove duplicated utilities/merge_operators/cassandra/test_utils.cc in src.mk 7c4a9e6c9 Initialize a variable in ldb to make code analysis tool happy 98669b535 init filters_in_partition_ 0013bf14e fix asan and valgrind leak report in test 521b4c28b rocksdb 5.5.1 release post 33042573d Fix GetCurrentTime() initialization for valgrind f6b9d9355 Fix clang error in PartitionedFilterBlockBuilder 45b9bb033 Cut filter partition based on metadata_block_size f4ae1bab0 update history for OnBackgroundError and DeleteRange fix 1cb8c6de6 Add -enable_pipelined_write to db_bench and add two defaults 7604b463b Update the AddDBStats in LITE 1e34d07e1 Simplify and document sync rules for logs_ etc d310e0f33 Regression test for empty dedicated range deletion file e9f91a517 Add a fetch_add variation to AddDBStats c1b375e96 skip generating empty sst 67b417d62 fix format compatible test afbef6518 Bug fix: Fast CRC Support printing is not honest 397ab1115 Improve Status message for block checksum mismatches 18c63af6e Make "make analyze" happy 01534db24 Fix the reported asan issues 1cd45cd1b FIFO Compaction with TTL 982cec22a Fix TARGETS file tests list b49b37109 allow numa >= 2.0.8 e517bfa2c CLANG Tidy dc3d2e4d2 update compatible test 89468c01d Fix Windows build broken by 5c97a7c0664d4071768113814e9ba71fe87e18cf 51778612c Encryption at rest support 7061912c2 Trivial typo in HISTORY.md 2a9cd8799 Fix jni WriteBatchThreadedTest 0025a3640 revert perf_context and io_stats to __thread 5c97a7c06 Unit Tests for sync, range sync and file close failures 4cee11f4e Intra-L0 blog post 857e9960b Improve the error message for I/O related errors. d757355cb Fix bug that flush doesn't respond to fsync result 8e6345d2d Update rename of ParanoidCheck 499ebb3ab Optimize for serial commits in 2PC 0ac4afb97 Sanitize partitioning options 521724ba8 fixed wrong type for "allow_compaction" parameter 71f5bcb73 Introduce OnBackgroundError callback 88cd2d96e Downgrade option sanitiy check level for prefix_extractor 6837a1762 Fix Data Race Between CreateColumnFamily() and GetAggregatedIntProperty() af1746751 WriteBufferManager will not trigger flush if much data is already being flushed 9467eb614 Fix flush assertion with tsan 048446fc7 Fix cassandra ASAN use-after-free a21db161c Implement ReopenWritibaleFile on Windows and other fixes c430d69ee fix coredump for release nullptr 0d278456c default implementation for InRange cbd825dee Create a MergeOperator for Cassandra Row Value 2c98b06bf Remove pin_slice option by making it the default c80c6115d add db_bench options for partitioning 6a3377f45 Synchronize statistic enumeration values between statistics.h and java API 53dda8797 Do not run RateLimiterTest.Rate test on Travis+Mac OSX. ae8571f5c Fix blob db compression bug 7a380deff Update blob_db_test 89ad9f3ad Allow ignoring unknown options when loading options from a file 6b5a5dc5d fixed typo 0f228be3b fixed typo in util/dynamic_bloom.h c217e0b9c Call RateLimiter for compaction reads 91e2aa3ce write exact sequence number for each put in write batch 6f4154d69 record index partition properties 5d5a28a98 Fix Clang release build broken by 5582123dee8426a5191dfd5e846cea8c676c793c 0175d58c3 Make direct I/O write use incremental buffer 7a270069b GNU C library for struct tm has 2 additional fields. d713471da Limit trash directory to be 25% of total DB 9bb91e932 Dedup release 27b450165 Update HistogramTypes in the Java API e97304c68 update history for 5.6 5582123de Sample number of reads per SST file db818d2d1 Fix RocksDB Lite build with CLANG a472c4ae4 update 5.5 change log bc09c8a0d Fix crash in PosixWritableFile::Close() when fstat() fails 6d0f22e42 Fix mock_env.cc uninitialized variable c2012d488 Java APIs for put, merge and delete in file ingestion 85dace2af Disable DBRangeDelTest::TailingIteratorRangeTombstoneUnsupported for ubsan d4f7731b6 fix travis error with init time in mockenv 550a1df72 Fix clang errors by asserting the precondition cc5f9339e Fix concurrency issue with filter_block_set_ 2e64f450d bump version to 5.6 afbc2d0d2 Force travis to build with clang on MacOS b172a3f1a Fix warnings while generating RocksJava documentation 52a7f38b1 WriteOptions.low_pri which can throttle low pri writes if needed 26a8a8071 Switch from CentOS 5 to CentOS 6 for crossbuilding RocksJava dba9f3722 Fix db_write_test clang/windows build failure c7662a44a fixed typo 7e8d95cc0 Fix the Java build which was broken by a4d9c02 7e5fac2c3 remove test dir before exit when current regression is running 7f6c02dda using ThreadLocalPtr to hide ROCKSDB_SUPPORT_THREAD_LOCAL from public… 138b87eae Fix interaction between CompactionFilter::Decision::kRemoveAndSkipUnt… 95b0e89b5 Improve write buffer manager (and allow the size to be tracked in block cache) a4d9c0251 Pass CF ID to MemTableRepFactory f68d88be5 Fix DBWriteTest::ReturnSequenceNumberMultiThreaded data race 215076ef0 Fix TSAN: avoid arena mode with range deletions 3a8a848a5 account for L0 size in estimated compaction bytes 0fae3f5dd codemod: format TARGETS with buildifier [5/5] (D5092623) 872199606 add checkpoint support for single db in regression test 5a9b4d743 Retire memenv https://github.com/facebook/rocksdb/pull/2082 d6019651b sync internal/external TARGETS bbaba51bb Add missing index type to C-API 292edfd51 travis: test with xcode8.3 (OS X 10.12) 0dc3040d5 db: avoid `#include`ing malloc and jemalloc simultaneously 9b3ed8350 fix regression test 9c9909bf7 Support ingest file when range deletions exist ad19eb868 Fixing blob db sequence number handling 51ac91f58 Histogram of number of merge operands 345878a7f update blob_db_test cbc821c25 change regression rebuild to one level 103d0692e Avoid unsupported attributes when not building with UBSAN 5fd04566c travis: reduce the number of travis builders 2d05002b9 RocksDB 5.4.5 release blog post 7eca90f18 Update RocksDB blog authors d03c34497 update comment of GetNextFile f7bb1a006 support merge and delete in file ingestion c2c62ad4e Reorder variables of ReadOptions 7bb1f5d48 Increase of compaction threads should be logged at info level instead of a warning 6c456ecae Clean zstd files 347e16f83 codemod: replace `headers = AutoHeaders.*` with `auto_headers` 0be636bf7 Fix db_bench build break with blob db 135ee6a3f fix tsan crash data race a99fb9928 fix column_family_test asan f41bffb3d travis: clang-3.6 -> clang-4.0 e7612798b update buckifer/TARGETS bb01c1880 Introduce max_background_jobs mutable option 5a2530462 Fix the CMakeLists for RocksJava 41cbb7274 options.delayed_write_rate use the rate of rate_limiter by default. 506803466 range sync should be enabled 02594b5f1 Fix build errors in blob_dump_tool with GCC 4.8 52d9e5f7b Fix column family seconds_up accounting 7d8207f1f Fix errors in clang-analyzer builds 85b8569ae Fix release build on Linux 69ec8356b Allow SstFileWriter to use the rate limiter 6cc9aef16 New API for background work in single thread pool 9d0a07ed5 Fix rocksdb.estimate-num-keys DB property underflow 578fb0b1d Simple blob file dumper ac39d6bec Core-local statistics 3e86c0f07 disable direct reads for log and manifest and add direct io to tests 15ba4d6c4 Address MS Visual Studio 2017 issue with autovector 88c818e43 Replace deprecated RocksDB#addFile with RocksDB#ingestExternalFile 228f49d20 Fix data races caught by tsan 4c9d2b104 remove #include port/port.h in public header file 07bdcb91f New WriteImpl to pipeline WAL/memtable write d746aead1 Suppress clang-analyzer false positive 217b866f4 column_family_test: EnvCounter::num_new_writable_file_ to be atomic 9f839a7f6 keep util/build_version.cc when make clean 7eecd40a4 add emacs tags file - etags 9bbba4fec Remoe unused BlockBasedTable::compaction_optimized_ f5ba131bf Fixed some spelling mistakes 146b7718f Fix mingw compilation with -DNDEBUG a36220ccf fix unity test 0ebdd7057 fixed typo 8032f4cb3 Remove -pie in TSAN 362ba9b02 Release RocksDB 5.5.0 ba685a472 Support ingest_behind for IngestExternalFile 01ab7b528 Add ROCKSDB_LIBRARY_API macro to a few C APIs, to fix windows build cb9392a09 add Transactions and Checkpoint to C API 445f1235b s/std::snprintf/snprintf cd593c283 Fix travis java_test f720796e2 fixed typo a48a62d5b define NDEBUG in CMake non-debug builds 1ca723dbd C API: support pinnable get 2ef15b85d Core-local stats blog post 4f9e69ccf fix log err 11c5d4741 cross-platform compatibility improvements d00433302 Put lib files into suitable path in RPM package 86d549253 Fix build error with blob DB. 254c46800 Fix the RocksJava Release on Windows 7a47b431f Fix .gitignore pattern fa5a15ceb Make sure that zstd is statically linked correctly in the Java static build 3fa9a39c6 Add GetAllKeyVersions API 1a60982a5 Simplified instructions for CentOS a5cc7ecec Facility for cross-building RocksJava using Docker ccd3dddf5 Blog post for partitioned index/filters b145c34d7 Update blog authors bbe9ee7dd core-local array type conversions c2be43430 Build and link with ZStd when creating the static RocksJava build c61e72c42 Add missing files of blob_db to CMake file 3907c94ff Fix ColumnFamilyTest:BulkAddDrop cda5fde2d CoreLocalArray class 93949667c update TARGETS 4e83b8001 title: Bulkoading -> title: Bulkloading d85ff4953 Blob storage pr 492fc49a8 fix readampbitmap tests be421b0b1 portable sched_getcpu calls 0f559abdb Add NO_UPDATE_BUILD_VERSION option to makefile 3a04a254a Flink state 35df23fe8 Fix suite exclisions e7cea86f7 Fixes the CentOS 5 cross-building of RocksJava 259a00eac unbiase readamp bitmap a62096696 port: updated PhysicalCoreID() df035b682 Print compaction_options_universal.stop_style in LOG file 4897eb250 dont skip IO for filter blocks 3f73d54bb Add C API to set max_file_opening_threads option 0b69e5079 Define CACHE_LINE_SIZE only when it's not defined 2cd00773c Add bulk create/drop column family API 40af2381e Object lifetime in cache fdaefa030 travis: add Windows cross-compilation a30a69603 do not read next datablock if upperbound is reached 2d42cf5ea Roundup read bytes in ReadaheadRandomAccessFile 264d3f540 Allow IntraL0 compaction in FIFO Compaction 8c3a180e8 Set lower-bound on dynamic level sizes 7c1c8ce5a Avoid calling fallocate with UINT64_MAX a45e98a5b max_open_files dynamic set, follow up 6b99dbe04 fix memory alignment with logical sector size e7ae4a3a0 Max open files mutable 60847a3b0 port: updated PhysicalCoreID() b551104e0 support PopSavePoint for WriteBatch 498693cf3 Remove orphaned Java classes 5e2ebf2bd travis: add CMake compilation af6fe69e4 Fix an issue of manual / auto compaction data race 6798d1f3b Revert "Delete filter before closing the table" 89833577a Delete filter before closing the table 47a09b0a8 Avoid pinning when row cache is accessed aeaba07b2 Remove an assert that causes TSAN failure. 0b90aa951 Set VALGRIND_VER a2b05210e Make PosixLogger::flush_pending_ atomic da4b2070b Fix WriteBatchWithIndex address use after scope error d616ebea2 Add GPLv2 as an alternative license. 4439b4596 Add documentation license 0ca3ead0c add GetRootDB() in DeleteFilesInRange cdad04b05 Remove double buffering on RandomRead on Windows. e15382c09 Disable two flaky tests 2150cc1f3 fix WritableFile buffer size in direct IO efc361ef7 Add user stats Reset API 6616e4d62 add prefetch to PosixRandomAccessFile in buffered io f6a27d0bc Extract statistics tests into separate file 7eddecce1 support bulk loading with universal compaction 3b4d1b7a4 add <sys/sysmacros.h> to avoid warning with glibc 2.25 e5e545a02 Reunite checkpoint and backup core logic 72c21fb3f call GetRootDB() before cast to DBImpl* in CancelAllBackgroundWork 4c9447d88 Add erase option to release cache 04d58970c AIX and Solaris Sparc Support afff9951e Respect deprecated flag in table options 066cfbacc Adding -noprofile to CMakeLists for Windows cb885bccf set compaction_iterator earliest_snapshot to max if no snapshot 7534ba7bd StackableDB should pass ResetStats() c1fbf91b2 Fixing Solaris Sparc crash due to cached TLS 963eeba48 Revert how check_format_compatible.sh checkout release branches. 97005dbd5 tools/check_format_compatible.sh to cover option file loading too 8f6196788 Add cpu usage to regression benchmarks (4th attempt) df74b775e Limit backups opened 1dd776051 Change L0 compaction score using level size 927bbab25 Revert "Add cpu usage to regression benchmarks (3rd attempt)" 8e84a388e Re-add index_per_partition but as deprecated 1553659d6 Add more recent versions to tools/check_format_compatible.sh 966ebb02f Hide event listeners from lite build 476e80be8 Add cpu usage to regression benchmarks (3rd attempt) c49d70465 Add DB:ResetStats() 0fcdccc33 Blob storage helper methods a6439d797 CMake: compile with -O2 e67f0adf3 enable O2 optimization for lz4 bc3973259 CMake: add support for SSE4.2 7d5f5aa97 Separate compile and link for shared library 071652734 remove warning 6e8d6f429 readahead backwards from sst end ca96654d8 Change Build Env to gcc-5 e9e6e5324 Simplify write thread logic 6799c7e00 Pass in remote as a param to branch creation script 44fa8ece9 change use_direct_writes to use_direct_io_for_flush_and_compaction 13b50358f add space for buggy kernel warning b6b9359ec Fix BYTES_WRITTEN accounting 13369fbd4 Update ShipIt to honor TARGETS updates f2449ce92 Remove .deprecated_arcconfig 415be221c RocksDB Release 5.4 : Update HISTORY.md and build version. 3eab41d7c java dependencies test -s -> use test -d a22ed4eab internal_repo_rocksdb to build Java and RocksDB LITE 9f2cc59ec sync TARGETS file 10d754696 set readahead buffer size from roundup(user_size) + 4k to roundup(use… ba7da434a fix db_stress crash caused by buggy kernel warning 6257837d8 Add ROCKSDB_JAVA_NO_COMPRESSION flag 6a6723ee1 Move MergeOperatorPinning tests to be with other merge operator tests 6a8d5c015 Revert "Report cpu usage using time command" 8f47a9751 File level histogram should be printed per CF, not per DB 9300ef545 Fix shared lock upgrades 1f8b119ed Limit maximum memory used in the WriteBatch representation 97ec8a134 Report cpu usage using time command 20778f2f9 Adding comments to the write path 7124268a0 Reduce the number of params needed to construct DBIter 04abb2b2d FreeBSD only requires WITH_JEMALLOC, not the rest 61730186d dummy diff 360e9960f Summary: Remove .arcconfig 69a5e6461 Deprecate .arcconfig 9690653db Add a verify phase to benchmarks dd8f9e38e Fix compilation for GCC-5 c2954f9b6 Add Travis job to build examples 72fc1e9d0 avoid non-existent O_DIRECT on OpenBSD ff9728701 Refactor compaction picker code 9e7293902 only FALLOC_FL_PUNCH_HOLE when ftruncate is buggy 343b59d6e Move various string utility functions into string_util 1d068f606 Fix CompactRange incorrect buffer release df6f5a377 Move memtable related files into memtable directory 107c5f6a6 CMake: more MinGW fixes d2dce5611 Move some files under util/ to separate dirs c50e3750d Use a human readable size for level report ce64b8b71 Divide db/db_impl.cc 02799ad77 Revert "delete fallocate with punch_hole" e2a7b202c Release note for partition filters af256eb2b build db every monday e5a1372b2 Rework test running script. d659faad5 Level-based L0->L0 compaction a12306fab Add a notice on gflags installation in INSTALL.md 43010a929 Revert "[rocksdb][PR] CMake: more MinGW fixes" a30b75cdc Add buckifier script to github repo 3450ac8c1 CMake: more MinGW fixes 90cfd4645 update IterKey that can get user key and internal key explicitly e2c6c0636 add TimedEnv 9e4453180 Refactor WriteImpl (pipeline write part 1) 6ef8c620d Move auto_roll_logger and filename out of db/ a1c469d71 Add release notes for PinnableSlice 0537f515c fix run_remote with strong quoting 72e600094 fixed misses on Centos library installation instructions 88cc81df5 auto_roll_logger_test to move away from real sleep d25e28d58 replace sometimes-undefined uint type with unsigned int a1d7e487b Add L0 write-amp to compaction level stats b6d609063 CMake: support AVX2 in MinGW bd7d13835 test remote instead run remote in regression test c81a805fe test db existence on the remote host 5fc1e6765 add -rf when remove db in regression test 4ab4049f2 gflags has moved to GitHub 4e0065015 make all DB::Get overloads virtual 6401a8b76 Fix build with MinGW 80fe5b385 disable test: DeleteSchedulerTest.DynamicRateLimiting1 a9c86f51b backup garbage collect shared_checksum tmp files da175f7ec exit with code 2 when there is already a db_bench running in regression test 0ee7f0403 Added missing options to RocksJava c6d04f2ec Option to fail a request as incomplete when skipping too many internal keys 58179ec4a Cleanup of ThreadStatusUtil structures should use the DB's reference f3607640a add ldb build to regression test 8a8c96746 Enable Fast CRC32 for Win64 f9813b853 Added SstFileWriter construtor without explicit comparator to JNI api 8d3cb4f20 Added naming of backup engine threads 67d762379 Expose the stalling information through DB::GetProperty() 0fd574926 delete fallocate with punch_hole 41fe9ad75 Hide usage of compaction_options_fifo from lite build e7731d119 Configure index partition size 69c8d524a Fix jni library name for PowerPC Architecture 34a70859b Fix segmentation fault caused by #1961 8dee8cad9 Enable fifo compaction benchmark to db_bench a5c8b5434 fix a header include 91b5feb37 Fix Windows Build broken by a recent commit 41ccae6d2 Add C API functions (and tests) for WriteBatchWithIndex 88bb6f6bf non_shm CI should run tests on /tmp 8888de2b1 Update .gitignore file in examples 203136e79 Fix Compilation errors when using IBM Java f4fce4751 Fix clang compile error - [-Werror,-Wunused-lambda-capture] a084b26a5 Blog post for releasing 5.2.1 15950fe3a Remove ASSERT_EQ(boolean, ...) 3e56c7e0c make total_log_size_ atomic 909028e21 HISTORY.md for log_size_for_flush in CreateCheckpoint() be723a8d8 Optionally construct Post Processing Info map in MemTableInserter e474df947 db_bench: not need to check mmap for PlainTable 8b0097b49 Readers for partition filter 9ef3627fd Allow checkpointing without flushing 17866ecc3 Allow Users to change customized ldb tools' header in help printing a2a883318 remove deleted option from benchmark.sh 78cb19559 add checkpoint to ldb 4b04addfc updated solution if "make format" command fails 8f5bf0446 Flush triggered by DB write buffer size picks the oldest unflushed CF 6908e24b5 dynamic setting of stats_dump_period_sec through SetDBOption() 93c68b642 change regression bash file with debug mode 21d8c3179 remove LIKELY from public headers 36ad75778 INSTALL: document USE_SSE 9272e12f1 avoid ftruncate twice in buffered io d52f334cb Break stalls when no bg work is happening e66221add fix db_bench rate limiter callsites dbae438a0 Replace "DEPRECATED" comment to "not supported" 995618a82 Support SstFileManager::SetDeleteRateBytesPerSecond() e19163688 Add macros to include file name and line number during Logging d525718a9 cleanup direct io flag in WritableFileWriter 5fa927aa9 Add Xpress and ZSTD CompressionType values to C header 11526252c Pinnableslice (2nd attempt) e5bd8def1 update history.md for fixing the bug that skips keys 1ffbdfd9a Add a new SstFileWriter constructor without explicit comparator ebd5639b6 Add ability to search for key prefix in sst_dump tool e6725e8c8 Fix some bugs in MockEnv 900c62be6 fix compile for VS2015 fe1835617 release 5.3 5dae01947 Revert "Report cpu usage using time command" f2817fb7f avoid ASSERT_EQ(false, ...); 5b11124e3 add max to histogram stats d43adf21b Report cpu usage using time command 18fc1bc0e minor changes for rate limiter test flakiness 12ba00ea6 Reset DBIter::saved_key_ with proper user key anywhere before pass to DBIter::FindNextUserEntry c9df05d1e Fix random access alignment f64991537 Add Bulkoading IngestExternalFile blog post 54b434110 Builders for partition filter 97edc72d3 Add a memtable-only iterator 72202962f fix db_sst_test flakiness 5f65dc877 Expose DB::DeleteRange and WriteBath::DeleteRange in Java 58b12dfe3 Set logs as getting flushed before releasing lock, race condition fix f8a4ea020 Move db_test and external_sst_file_test out of Travis's MAC OS run 534581a35 Fix a bug in tests in options operator= a2f7a514d Refactoring 2a5daa06f Add stderr log level for ldb backup commands 4561275c2 fix rate limiter test flakiness 7c80a6d7d Statistic for how often rate limiter is drained 0ad5af42d Clarify VerifyBackup behavior 6fb901344 sanitize readahead when direct read enabled f89b3893c Remove skip_table_builder_flush and default it to true cc253982d Use more default options in db_bench 8432bcf55 Make compaction_pri settable through option string d5b607a43 Make db_wal_test slightly faster ba4c77bd6 Divide external_sst_file_test e877afa08 Remove bulk loading and auto_roll_logger in rocksdb_lite 90d835507 Fix the wrong address for PREFETCH in DynamicBloom::Prefetch 08864df21 Move advanced column family options to advanced_options.h 2ca2059f6 Get unique_ptr to use delete[] for char[] in DumpMallocStats 253799c06 Add missing include for `abort()` c6d464a9d Fixed various memory leaks and Java 8 JNI Compatibility be3e5568b Fix unaligned reads in read cache 8ad0fcdf9 Separate small subset tests in DBTest 6c951c43c Run fewer tests in OSX f7997f134 add direct I/O to version notes 5.2.0 3b8ba703c Fix flaky DBTestUniversalCompaction.UniversalCompactionTrivialMoveTest2 96c7e1504 Fix Java build e0b87afc7 Black list some slow valgrind tests e67232cff Handle failed Finish() in SST file writer 8efb5ffa2 [rocksdb][PR] Remove option min_partial_merge_operands and verify_checksums_in_comp… 1ba2804b7 Remove XFunc tests e7d902e69 add direct_io and compaction_readahead_size in db_stress 1ef5f50e8 detect logical sector size ed50308d2 check backup directory exists before listing children 4d7c06ced Make WriteBatchWithIndex moveble 5040414e6 Gracefully handle previous backup interrupted f206af56f add use_direct_io() to ReadaheadRandomAccessFile 082493442 truncate patch 286a36db7 posix writablefile truncate f0879e4c3 Page size isn't always 4k on linux 18eeb7b90 Fix interference between max_total_wal_size and db_write_buffer_size checks 1560b2f5f Temporarly return deprecated functions to fix MongoRocks build 2a0f3d0de level compaction expansion ebc8a7998 alignment is on in ReadaheadRandomAccessFile::Read() 381fd3224 Remove timeout_hint_us from WriteOptions fce7a6e19 Fail IngestExternalFile when bg_error_ exists a618a16f4 New subcode for IOError to detect the ESTALE errno 7ab005183 Remove deprecated DB::AddFile and DB::CompactRange 401667366 Adding Dlang to the list 756c5924e Allow adding external v1 sst file with no global seqno support aa0298fa9 Remove trailing whitespace from examples Makefile db2b4eb50 avoid direct io in rocksdb_lite 43e9f01c2 Fix repair_test on ROCKSDB_LITE 7106a994f Use monotonic time points in write_controller.cc and rate_limiter.cc c2247dc1c Make DBImpl::has_unpersisted_data_ atomic eb912a927 Remove disableDataSync option 0227c16d6 Update static library versions and add checksums b3aae4d07 Add repair_test to make check 421ce7c2b Add support for JNI Library on Linux on PowerPC. 9afa20cf2 Increase build version and HISTORY.md for releasing 5.2 a5adda064 Fix repair issues b48e4778b Consolidate file cutting logic in compaction loop ac2a77a74 Announce the experimetnal two-level index feature in HISTORY.md c4a37dcb4 Print the missed last layer in cfstats a12818afc Blog post for 5.1.2 release 3b4ac8076 Clarify ldb column family argument d70ce7ee0 Move db_bench flags out of unnamed namespace 186c7eedb Remove incorrect statistics warning 53bb01516 [rocksdb][PR] compaction_style and compaction_pri should output their value as a st… 69d5262c8 Two-level Indexes 0a4cdde50 Windows thread 1aaa898cf Adding GetApproximateMemTableStats method 9fc23c55f Use gcc-4.9-glibc-2.20-fb python in precommit_checker b797e4215 Dump compression dictionary meta-block 036d668b1 Fix wrong result in data race case related to Get() 574b543f8 Rename merger.h -> merging_iterator.h add8b50cc Move ThreadLocal implementation into .cc 71d2496af Fix arc setting for Facebook internal tools f289d9f4a Fix OSX build break after the fallocate change 4a3e7d320 Change the default of delayed slowdown value to 16MB/s 0513e21f9 RangeSync() should work with ROCKSDB_FALLOCATE_PRESENT not set 8b369ae5b Cleaner default options using C++11 in-class init ec79a7b53 Dedup code in option.cc and db_options.cc b96372dea improving the C wrapper 04c4ec41d Change corruption_test to use 4 bits. 2d75cd40d NewLRUCache() to pick number of shard bits based on capacity if not given f25f1ec60 Add test DBTest2.GetRaceFlush which can expose a data race bug 37d4a79e9 Deserialize custom Statistics object in db_bench 3b35134e4 Avoid cache lookups for range deletion meta-block 94a0c32e7 Fix LRU Ref() for handles with external references only 17c118060 Generalize Env registration framework 07dddd5f7 EnvPosixTestWithParam should wait for all threads to finish 5dad9d6d2 Avoid logs_ operation out of DB mutex a7b13919b Fix CompactFiles() bug when used with CompactionFilter using SuperVersion 616a1464e Fix DeleteRange including sentinels in output files c918c4b76 Update USERS.md add user Pika 03ca2ac8a Remove function from DBImpl that are not used anywhere b0029bc7f Test merge op covered by range deletion in memtable d438e1ec1 Test range deletion block outlives table reader fba726e55 Version librocksdb.so 9da4d542f Range deletions unsupported in tailing iterator f2b4939da fixed typo 973f1b78f memtable: delete merge value for range deleteion aebfd1703 fix non-portable behavior in encoder 753ff84a3 Fix get approx size d7ea44f2f Fixup a couple of builds errors on Linux. 537da370d c: allow set savepoint to writebatch af6ec4d78 fix batchresult handle leak e29bb934f Zlib 1.2.8 is no longer available, switched to 1.2.10 5ac97314e Fix std::out_of_range when DBOptions::keep_log_file_num is zero 4e35ffdfa cmake: check -momit-leaf-frame-pointer before using it 3c0852d1d Make ingest external file backward compatible 0e8dfd606 Fix OptimizeForPointLookup() e840213d6 Change DB::GetApproximateSizes for more flexibility needed for MyRocks 9239103cd Flush job should release reference current version if sync log failed da54d36a9 Disable IngestExternalFile in ReadOnly mode 5cf176ca1 Fix for 2PC causing WAL to grow too large 4a73bb0b4 Split travis jobs c70d3c7ad Enable DBTest.GroupCommit as it runs in a reasonlable time now. 602c13a96 Remove fadvise with direct IO read f9d18e22d Fix DeleteRange file boundary correctness issue with max_compaction_bytes 3ce091fd7 Add KEEP_DB env var option 77b480662 Fix 2PC with concurrent memtable insert e8a096000 util/thread_local.h: silence a clang-build warning 324a0f988 Follow up for DirectIO refactor bc5d7b702 travis: For linux, do all tests under gcc 3e6899d11 change UseDirectIO() to use_direct_io() d4e07a845 fix warning of unused direct io helper functions dc2584eea direct reads refactor d18dd2c41 Abort compactions more reliably when closing DB 62384ebe9 Guarding extra fallocate call with TRAVIS because its not working pro… 9f246298e Performance: Iterate vector by reference fe395fb63 Allow incrementing refcount on cache handles 2172b660e Fix build on FreeBSD 3c233ca4e Fix Windows environment issues 763173456 Fix the error in ColumnFamiliesTest 7a02ad070 Update travis to ubuntu trusty 60c509ff1 Fix valgrind failure in test CurrentFileModifiedWhileCheckpointing2PC d0ba8ec8f Revert "PinnableSlice" 54d94e9c2 PinnableSlice e04480fae Fix MS warnings. Use ROCKSDB_Prsz for size_t. c081f7215 5.0.1 release blog post ac73d7558 Add GetSupportedCompressions() convenience function b104b8781 Maintain position in range deletions map 640d72480 Update db_bench and sst_dump to test with block cache mid-point inser? 653ac1f9c C API: support total_order_mode 85ac1a320 Fix rocksdb::Status::getState 76711b6e7 Make ExternalSSTFileTest::CompactionDeadlock more deterministic c963460db Fix tests under GCC_481 33c86d677 Fix backupable db test e425ec116 utilities/backupable: backup should limit the copy size of wal. 0712d541d Delegate Cleanables d58ef52ba Allow SstFileWriter to Fadvise the file away from page cache 17a4b75cc Always fsync the file after file copying 2fb70dc79 examples: Add options_file_example to target all a738af8f8 db/pinned_iterators_manager.h: bugfix 906523d98 Add description to the 2PC checkpooint bug in HISTORY.md 438f22bc5 Fix bug of Checkpoint loses recent transactions with 2PC 335981d47 Fix the directory path for RocksDB repo 548b62805 Enable conditionally using adaptive mutexes 4e07b08ef include/rocksdb/utilities/env_librados: fix typo ab48c165a Print cache options to info log 972f96b3f direct io write support 989e644ed Remove sst_file_manager option from LITE 1beef6569 Fix c_test 3d692822f persistent_cache: fix two timer 046099c9b The array is malloced by backtrace_symbols(), and must be freed 6ff2c8d7f Remove gflags as travis build dependency 3cd9ed1c3 Show sandcastle URL in phabricator 50e305de9 Collapse range deletions 5d1457dbb Dump persistent cache options 7bd725e96 db_bench: introduce --benchmark_read_rate_limit 296691847 Update Netflix section of USERS.md 342370f1d Simplify MemTable::Update 1a136c1f1 Expose file size fbff4628a Reduce compaction iterator status checks bd6cf7b51 WritableFileWriter: default buffer size equal min(64k,options.writabl? fc0c6fd98 "make format" format diff since last commit from master 816c1e30c gcc-7 requires include <functional> for std::function c27073586 Iterator should be in corrupted status if merge operator return false a8bf4d63f Make format shows wrong curl command for retrieving clang-format-diff.py 8f5d24ae6 C API: support get usage and pinned_usage for cache 0ab6fc167 Gcc-7 buffer size insufficient b7239bf7e Gcc 7 fallthrough 477b6ea57 std::remove_if requires <algorithm> 83f9a6fd2 Fail BackupEngine::Open upon meta-file read error a79eae4b0 Add pcache documentation images d71e728c7 Print user collected properties in sst_dump 7004a6f7b Add missing copyright header 3cdfaeca3 Fixes for MSVC compilation e097222e6 util/logging.cc: buffer of insufficient size (gcc-7 -Werror=format-length) cfc34d7c4 Missing break in case in DBTestBase::CurrentOptions bfbcec233 Gcc 7 error expansion to defined 6653e32ac build: make it easier to pass PORTABLE 67adc937b intentional fallthough (prevents gcc-7/clang-4 error) 1a146f89c break Flush wait for dropped CF c3e5ee715 util/histogram.cc: HistogramStat::toString buffer insufficient 5334d8b44 table/block_based_table_builder.cc: intentional fallthrough - comment to match gcc pattern 36d42e65d Disable test to unblock travis build b57dd9262 C API: support writebatch delete range 2ba59b5a1 Disallow ingesting files into dropped CFs 1f6f7e3e8 cast to signed char in ldb_cmd_test for ppc64le 243975d5d More accurate error status for BackupEngine::Open f0c509e2c Return finer-granularity status from Env::GetChildren* dc64f46b1 Add db_bench option for stderr logging 2cabdb8f4 Increase buffer size 4a17b47bb Remove unnecessary header include 8c2b921fd Fixed a crash in debug build in flush_job.cc 20ce081fa Fix issue where IngestExternalFile insert blocks in block cache with g_seqno=0 5241e0dbf fix db_bench argument type c04f6a0b4 Specify shell in makefile 45c7ce137 CompactRangeOptions C API 2c2ba6824 db_stress support for range deletions b821984d3 DeleteRange read path end-to-end tests 2f4fc539c Compaction::IsTrivialMove relaxing 1dce75b2e Update USERS.md 304b3c706 Update USERS.md fa50fffaf Option to expand range tombstones in db_bench c26a4d8e8 Fix compile error in trasaction_lock_mgr.cc ed8fbdb56 Add EventListener::OnExternalFileIngested() event 2005c88a7 Implement non-exclusive locks 0b0f23572 Mention IngestExternalFile changes in HISTORY.md 23db48e8d Update HISTORY.md for 5.0 branch beb36d9c1 Fixed CompactionFilter::Decision::kRemoveAndSkipUntil 67f37cf19 Allow user to specify a CF for SST files generated by SstFileWriter 9053fe2a5 Made delete_obsolete_files_period_micros option dynamic edde954e7 fix clang build 56281f3a9 Add memtable_insert_with_hint_prefix_size option to db_bench 4a21b1402 Cache heap::downheap() root comparison (optimize heap cmp call) e39d08087 Fix travis (compile for clang < 3.9) 3f407b065 Kill flashcache code in RocksDB b77007df8 Bug: paralle_group status updated in WriteThread::CompleteParallelWorker 247d0979a Support for range skips in compaction filter 96fcefbf1 c api: expose option for dynamic level size target 00197cff3 Add C API to set base_backgroud_compactions 5b219eccb deleterange end-to-end test improvements for lite/robustness aad119176 pass rocksdb oncall to mysql_mtr_filter otherwise tasks get created w… e33352899 DeleteRange write path end-to-end tests 7784980fc Fix mis-reporting of compaction read bytes to the base level 3c6b49ed6 Fix implicit conversion between int64_t to int b3b875657 Remove unused assignment in db/db_iter.cc 4f6e89b1d Fix range deletion covering key in same SST file a2bf265a3 Avoid intentional overflow in GetL0ThresholdSpeedupCompaction 52fd1ff2c disable UBSAN for functions with intentional -ve shift / overflow 1886c435b Fix CompactionJob::Install division by zero 63c30de80 fix options_test ubsan 13e66a8f5 Fix compaction_job.cc division by zero 01eabf737 Fix double-counted deletion stat 7ffb10fc1 DeleteRange compaction statistics 236d4c67e Less linear search in DBIter::Seek() when keys are overwritten a lot cd7c4143d Improve Write Stalling System dfb6fe675 Unified InlineSkipList::Insert algorithm with hinting 3068870cc Making persistent cache more resilient to filesystem failures 734e4acaf Eliminate redundant cache lookup with range deletion 182b940e7 Add WriteOptions.no_slowdown 4118e1333 Persistent Cache: Expose stats to user via public API f2a8f92a1 rocks_lua_compaction_filter: add unused attribute to a variable 4444256ab Remove use of deprecated LZ4 function 548d7fb26 Fix fd leak when using direct IOs fd43ee09d Range deletion microoptimizations 23a18ca5a Reword support a little bit to more clear and concise 481856ac4 Update support to separate code issues with general questions a0deec960 Fix deadlock when calling getMergedHistogram fe349db57 Remove Arena in RangeDelAggregator e63350e72 Use more efficient hash map for deadlock detection a13bde39e Skip ldb test in Travis 73843aa63 Direct I/O Reads Handle the last sector correctly. 9d60151b0 Implement PositionedAppend for PosixWritableFile 3f6221521 Lazily initialize RangeDelAggregator's map and pinning manager 41e77b839 cmake: s/STEQUAL/STREQUAL/ c1038d283 Release RocksDB 5.0 635a7bd1a refactor TableCache Get/NewIterator for single exit points f39452e81 Fix heap use after free ASAN/Valgrind a4eb7387b Allow plain table to store index on file with bloom filter disabled 36e4762ce Remove Ticker::SEQUENCE_NUMBER 86eb2b9ad Fix src.mk 0765babe1 Remove LATEST_BACKUP file 647eafdc2 Introduce Lua Extension: RocksLuaCompactionFilter 760ef68a6 fix deleterange asan issue 327085b7b fix valgrind 715591bba Ask travis to use JDK 7 972e3ff29 Enable allow_concurrent_memtable_write and enable_write_thread_adaptive_yield by default 420bdb42e option_change_migration_test: force full compaction when needed 1543d5d92 Report memory usage by memtable insert hints map. 018bb2ebf DeleteRange support for db_bench dc51bd716 CMakeLists.txt: FreeBSD has jemalloc as default malloc 48e8baebc Decouple data iterator and range deletion iterator in TableCache 4b0aa3c4c Fix failed compaction_filter_example and add it into make all 53b693f5f ldb support for range delete 661e4c926 DeleteRange unsupported in non-block-based tables 489d14280 DeleteRange interface eba99c28e Fix min_write_buffer_number_to_merge = 0 bug 2ef92fea5 Remove all instances of relative_url until GitHub pages problem is fixed. 91300d01f Dynamic max_total_wal_size option ec2f64794 Consider subcompaction boundaries when updating file boundaries for range deletion 800e51553 Fix CSS issues again b952c898b Parallize persistent_cache_test and transaction_test 3b192f618 Handle full final subcompaction output file with range deletions 6c5795200 Make range deletion inclusive-exclusive 425210cc4 CSS issues are arising on the Github Pages side. Temp fix. 1ea79a78c Optimize sequential insert into memtable - Part 1: Interface df5eeb85c Optimize sequential insert into memtable - Part 2: Implementation 5ed650857 Fix SstFileWriter destructor adb665e0b Allowed delayed_write_rate option to be dynamically set. 307a4e80c sst_dump support for range deletion 361010d44 Exporting compaction stats in the form of a map 672300f47 Use relative Urls for stylesheets b39b2ee12 do not call get() in recovery mode 1ca5f6d13 Fix 2PC Recovery SeqId Miscount e095d0cbc Rocksdb contruns to new Sandcastle API 14c0380e7 Convenience option to parse an internal key on command line c90fef88b fix open failure with empty wal 4e20c5da2 Store internal keys in TombstoneMap a9fb346e4 Fix RocksDB Lite build failure in c_test.cc d133b08f6 Use correct sequence number when creating memtable 144cdb8f1 16384 as e.g .value for compression_max_dict_bytes 9bd191d2f Fix deadlock between (WriterThread/Compaction/IngestExternalFile) a9fae0a9d CSS problems again :( 193221e0a Fix Forward Iterator Seek()/SeekToFirst() e48f3f8b9 remove tabs and duplicate #include in c api 85bd8f518 Minor fix to GFLAGS usage in persistent cache a7875272d c: support seek_for_prev 0f17f9279 Make the header links a bit more flexible cf19f559d single quotes in feed 2dc019e09 Fix header links f1aedda06 More Jekyll 3.3 fixes c54cdc378 More Jekyll 3.3 updates 2bcaf8246 Update product and feature template for Jekyll 3.3 24bceb096 Java API - Implement GetFromBatch and GetFromBatchAndDB in WBWI 815f54afa Insert range deletion meta-block into block cache 9e7cf3469 DeleteRange user iterator support 5c5d01ae7 Fix wrong comment (Maximum supported block size) f998c9790 DeleteRange Get support 879f36636 Add C api for RateLimiter 557034f36 Remove all instances of baseurl 437942e48 Add avoid_flush_during_shutdown DB option 2b16d664c Change max_bytes_for_level_multiplier to double 16fb04434 expose IngestExternalFile to c abi ce22ea99a Fix casts for MSVC 196af035c Introduce FAIL_ON_WARNINGS CMake variable (default ON) 40a2e406f DeleteRange flush support d5555d95a Fix MSVC compile error in 32 bit compilation da61f348d Print compression and Fast CRC support info as Header level f9eb56791 db_bench: --dump_malloc_stats takes no effect 6a4faee5c fix freebsd build include path err and so & jar file name c90c48d3c Show More DB Stats in info logs 1b295ac8a DBTest.GetThreadStatus: Wait for test results for longer 25f5742f0 Update documentation to point at gcc 4.8 b50a81a2b Add a test for tailing_iterator 04751d534 L0 compression should follow options.compression_per_level if not empty 2946cadc4 Improve RangeDelAggregator documentation 0a9fd05c2 Update Vagrant file (test internal phabricator workflow) fcd1e0bf6 Make rocksdb work with internal repo 0aab5e55f FreeBSD: malloc_usable_size is in <malloc_np.h> (#1428) 9c0bb7f17 cmake: drop "-march=native" from CXX_FLAGS (#1429) eeb27e1bb Add handy option to turn on direct I/O in db_bench (#1424) c6168d13a removed some declarations from c.h which resulted in undefined symbols (#1407) bc429de49 revert fractional cascading in farward iterator b9bc7a2aa Use skiplist rep for range tombstone memtable 60a2bbba9 Makefile: generate util/build_version.cc from .in file (#1384) 9ee84067f Disable DBTest.RepeatedWritesToSameKey (#1420) f41df3045 OptionChangeMigration() to support FIFO compaction 2e8004e60 Changing the legocastle run to use valgrind_test instead of _check 9de2f7521 revert Prev() in MergingIterator to use previous code in non-prefix-seek mode 24495186d DBSSTTest.RateLimitedDelete: not to use real clock 1168cb810 Fix a bug that may cause a deleted row to appear again 99c052a34 Fix integer overflow in GetL0ThresholdSpeedupCompaction (#1378) f83cd64c0 Fix a bug that mistakenly disable regression_test.sh to update commit (#1415) 0e926b84f Passing DISABLE_JEMALLOC=1 to valgrind_check if run locally 4dfaa6610 Make IsDeadlockDetect() virtual member of Transaction 59a7c0337 Change ioptions to store user_comparator, fix bug 869ae5d78 Support IngestExternalFile (remove AddFile restrictions) 1d9dbef64 Restrict running condition of UniversalCompactionTrivialMoveTest2 4edd39fda Implement deadlock detection 48fd619a4 Minor fixes to RocksJava Native Library initialization (#1287) 48e4e842b Disable auto compactions in memory_test and re-enable the test (#1408) fb2e41294 column_family_test: disable some tests in LITE 5af651db2 fix data race in compact_files_test a0ba0aa87 Fix uninitialized variable gcc error for MyRocks b88f8e87c Support SST files with Global sequence numbers [reland] 08616b493 [db_bench] add filldeterministic (Universal+level compaction) 52c9808c3 not split file in compaciton on level 0 5e0d6b4cc fix db_stress assertion failure ab5399837 Bump RocksDB version to 4.13 (#1405) b4d07123c SamePrefixTest.InDomainTest to clear the test directory before testing aa09d0338 Avoid calling GetDBOptions() inside GetFromBatchAndDB() 6fbe96baf Compaction Support for Range Deletion 257de78d9 Remove "-Xcheck:jni" from Java tests (#1402) d88dff4ef add seeforprev in history 5027dd17a Fix a minor bug in the ldb tool that was not selecting the specified (#1399) fea6fdd67 Fix @see in two Java functions (#1396) b1031d6c1 Remove function local statics that interfere with memory pooling (#1392) f47054015 Handle WAL deletion when using avoid_flush_during_recovery e29d3b67c Make max_background_compactions and base_background_compactions dynamic changeable 21e8daced fix assertion failure in Prev() b9311aa65 Implement WinRandomRW file and improve code reuse (#1388) a249a0b75 check_format_compatible.sh to use some branch which allows to run with GCC 4.8 (#1393) 040328a30 Remove an assertion for single-delete in MergeHelper::MergeUntil 8cbe3e10c Relax the acceptable bias RateLimiterTest::Rate test be 25% f26a139d8 Log successful AddFile 5691a1d8a Fix compaction conflict with running compaction 017de666c fixup commit 1b7af5fb1 Redo handling of recycled logs in full purge 27bfe327b Editorial change to README.md 89cc404de A bit of doc restructuring 9e7fda829 Fix arcanist 2e4b5cab0 Add missing RateLimiter class to the Windows build (#1382) ce4963fdf [doc] Document that Visual Studio 2015+ is now required for Windows builds (#1389) e48927098 Fix scoped arena iterator (#1387) f8d8cf53f Fix log_write_bench -bytes_per_sync option. (#1375) 02b3e3985 Make txn->GetState() const 447f17127 new Prev() prefix support using SeekForPrev() 991b585ee More block cache tickers d6ae6dec6 Add Statistics::getAndResetTickerCount(). aea3ce4c8 Avoid string CONCAT which is not supported in cmake 2.6 (#1383) 2ad68b971 Support running consistency checks in release mode 67501cfc9 Fix -ve std::string::resize 04b02dd12 Testing asset links after config change 8c55bb87c Make Lock Info test multiple column families d06232897 Revert "Support SST files with Global sequence numbers" 5cd28833a [RocksJava] Adjusted RateLimiter to 3.10.0 (#1368) 37737c3a6 Expose Transaction State Publicly 2c1f95291 Add facility to write only a portion of WriteBatch to WAL 043cb62d6 Fix record_size in log_write_bench, swap args to std::string::assign. (#1373) 4985f60fc env_mirror: fix a few leaks (#1363) 5aded67dd update of c.h (#1371) 912aec13c "Recent Posts" -> "All Posts" 7cbb298db Make sure that when contribtuing we call out creating appropriate directories a06ad4711 Add top level doc information to CONTRIBUTING.md 3fdd5b971 A little more generic CONTRIBUTING.md ed4fc31db Add link to CONTRIBUTING.md to main docs README.md e4922e181 Forgot to truncate one blog post 6d8cd7ede Add CONTRIBUTING.md for rocksdb.org contribution guidance bd55e5a1e Fix some formatting of compaction blog post 0f60358b0 CRLF -> LF mod (including removing trailing whitespace for those files) b90e29c90 Truncate posts on the main /blog/ page 0d7acadaf Add author fields to blog posts 01be44181 Add GitHub link to the landing page header 9d6c96138 Fix Mac build ab01da543 Support SST files with Global sequence numbers d346ba246 Minor fixes around Windows 64 Java Artifacts (#1366) e91b4d0cf Add factory method for creating persistent cache that is accessible from public be1f1092c Expose transaction id, lock state information and transaction wait information 6009c473c Store range tombstones in memtable 3c21c64c7 Use size hint for HashMap in multiGet. Similar to https://github.com/facebook/rocksdb/pull/1344 (#1367) 13f7a01f6 Fixing JNI release build for gcc (#975) 7260662b3 Add Java API for SstFileWriter 26388247a delete unused variable for PrevInterval() 87dfc1d23 Fix conflict between AddFile() and CompactRange() eb44ed655 Update 2016-09-28-rocksdb-4-11-2-released.markdown e4437610d Update 2016-09-28-rocksdb-4-11-2-released.markdown 501f05108 Update 2016-09-28-rocksdb-4-11-2-released.markdown dec9009f8 Update 2016-09-28-rocksdb-4-11-2-released.markdown 4ed69dd0b Create 2016-09-28-rocksdb-4-11-2-released.markdown 21f4bb5a8 cmake support for linux and osx (#1358) 4defe306f fix typo in comments (#1360) f517d9dd0 Add SeekForPrev() to Iterator eb3894cf4 Recompute compaction score on SetOptions (#1346) 5c64fb67d Fix AddFile() conflict with compaction output [WaitForAddFile()] 9e9f5a0b9 Fix CompactFilesTest.ObsoleteFiles timeout (#1353) c2a62a4cb not cut compaction output when compact to level 0 9ed928e7a Split DBOptions into ImmutableDBOptions and MutableDBOptions 4bc8c88e6 Recover same sequence id from WAL (#1350) 0a1bd9c50 add cfh deletion started listener da5a9a65c Fix mac build d45eb6c6d Fix typo (#1349) abc0ae462 Add AddFile() InternalStats for Total files/L0 files/total keys ingested 715256338 forbid merge during recovery 5735b3dc2 Fix compiling under -Werror=missing-field-initializers 654ed9a28 loose the assertion condition of rate_limiter_test e4d3f5d9b Fix DBImpl::GetWalPreallocateBlockSize Mac build error 7afbb7420 solve the problem of table_factory_to_write_=nullptr (#1342) d78a4401b DBImpl::GetWalPreallocateBlockSize() should return size_t 42ac9c5f1 Retry getting arcanist token on failure b666f8544 Consider more factors when determining preallocation size of WAL files 4c3f4496b Add TableBuilderOptions::level and relevant changes (#1335) 3edb9461b Avoid hard-coded sleep in EnvPosixTestWithParam.TwoPools 0a88f38b7 Remove ColumnFamilyData::options() 41a9070f8 Fix java makefile dependencies 8d9bf5c49 Fix DBOptionsTest.GetLatestOptions 40cfa3e02 Fix DBWALTest.RecoveryWithLogDataForSomeCFs with mac 06b4785fe Fix recovery for WALs without data for all CFs d7242ff4d Fix GetSortedWalFiles when log recycling enabled 17f76fc56 DB::GetOptions() reflect dynamic changed options 215d12826 Fix typo (#903) a958c2643 Rename jvalue to jval in rocksjni 0a165bd7d Have Facebook link point to RocksDB on FB 3639f3288 Fix bug in UnScSigned-off-by: xh931076284 <931076284@qq.com> (#1336) 8e061f974 Refactor GetMutableOptionsFromStrings 81747f1be Refactor MutableCFOptions ba65c816b Support POSIX RandomRWFile 1d980a8e3 Create CNAME 2adab1dde Add API links to the header bar a182b2981 Preserve blog comments in markdown f54de9230 Adding Dgraph to list of Users (#1291) 9e4aa798c Summary: (#1313) a10e8a056 Fix C api memtable rep bugs. (#1328) eb1d4d53c Release RocksDB 4.12 22d88e24d Allow an offset as well as a length to be specified for byte[] operations in RocksJava JNI (#1264) b06b19136 add C api for set wal_recovery_mode (#1327) 1cca09129 Temporarily revert Prev() prefix support de28a2553 Update HISTORY.md for thread-local stats 0fcb6dbed Remove extraneous function prototypes from c.h (#1326) 52ee07b02 Move AddFile() tests to external_sst_file_test.cc 66a91e260 Add NoSpace subcode to IOError (#1320) 67036c040 Fix Flaky ColumnFamilyTest.FlushCloseWALFiles 0e2da497c fix typo in option.h's comment (#1321) 6d61358a0 Add real Google Analytics ID 2d9d36ea4 Have "Edit on GitHub" point to master instead of gh-pages 937751898 Update landing page content 1ec75ee76 Add redirects from old blog posts link to new format 607628d34 Support ZSTD with finalized format ce1be2ce3 Fix build error on Windows (AppVeyor) (#1315) f7669b40b Fix Windows Build 22696b088 Fix uninitlized CompactionJob::SubcompactionState::current_output_file_size c1865e0f7 Trigger more tests per diff a88677d2c Remove ImmutableCFOptions from public API 80c75593e Fix data race in AddFile() with multiple files + custom comparator bug 5051755e3 Fix db_bench memory use after free (detected by clang_analyze) 4fd08f4b8 Ensure Correct Behavior of StatsLevel kExceptDetailedTimers and kExceptTimeForMutex (#1308) e14fbaae2 Add FAQ based on the front page of the current rocksdb.org 3c2262400 Migrate the RocksDB Worpdress blog over to Jekyll ee0e2201e Transfer the current Getting Started contents to GitHub Pages 5a0e9a4cf Initial Landing Page 9447a8540 Remove the `doc` directory 32149059f Merge options source_compaction_factor, max_grandparent_overlap_bytes and expanded_compaction_factor into max_compaction_bytes 4590b53a4 add stats to Cache::LookUp() 85bb30825 Expose Utility function StringToMap() (#1306) 8ce1b8440 Fix Travis on Mac 380e651af Fix Mac build failure (#1309) 1613fa949 Thread-specific histogram statistics 6a14d55bd add prefix_seek_mode to db_iter_test de47e2bd4 Fix ClockCache memory leak f099af4c7 Fix travis db74b1a21 fix bug in merge_iterator when data race happens b18f9c9ea add nullptr check to internal_prefix_transform 4e395e875 Update docs README.md 2482d5fb4 support Prev() in prefix seek mode 7541c7a79 Fix cache_test valgrind_check failure c8513cde0 Update the download location of Snappy (#1304) b49b92cf2 Introduce Read amplification bitmap (read amp statistics) c7004840d store prefix_extractor_name in table 4ad928e17 add comment to SimCache to estimate actual capacity e9b2af87f Expose ThreadPool under include/rocksdb/threadpool.h 23a057007 Document memtable flush behavior in CancelAllBackgroundWork() dade61ac2 Mitigate regression bug of options.max_successive_merges hit during DB Recovery cce702a6e [db_bench] Support single benchmark arguments (Repeat for X times, Warm up for X times), Support CombinedStats (AVG / MEDIAN) 3586901f8 cat tests logs sorted by exit code b2ce59537 Persist data during user initiated shutdown 4b3438d2d Fix parallel valgrind (valgrind_check) a081f798b Relax consistency for thread-local ticker stats b10d65c2a Update and slightly clarify instructions in build_detect_platform (#1301) f85f99bf6 Fix the Windows build of RocksDB Java. Similar to https://github.com/facebook/rocksdb/issues/1220 (#1284) 7b8109517 Fix a crash when compaction fails to open a file 7c9586837 Thread-specific ticker statistics ea9e0757f Add initial GitHub pages infra for RocksDB documentation move and update. (#1294) 2a9c97108 [Flaky Test] Disable DBPropertiesTest.GetProperty d76ddf327 Disable ClockCache db_crashtest cec2c6436 fix data race in NewIndexIterator() in block_based_table_reader.cc badbff65b Not insert into block cache if cache is full and not holding handle 4a16c32ec Option to cache index/filter blocks with priority 99c4af716 Make ClockCache available with TSAN build f57bc1d03 Fix lambda expression for clang/windows 5440675c3 Fix lambda capture expression for windows 6584cec8f Fold function for thread-local data 817eeb29b Add singleDelete to RocksJava (#1275) ffdf6eee1 Add Status to RocksDBException so that meaningful function result Status from the C++ API isn't lost (#1273) ecf900386 Fix bug in printing values for block-based table 72f8cc703 LRU cache mid-point insertion 6a17b07ca Add TablePropertiesCollector support in SstFileWriter 78837f5d6 TableBuilder / TableReader support for range deletion 4cc37f59e Introduce ClockCache ff17a2abf Adding TBB as dependency. 49d88be02 c abi: allow compaction filter ignore snapshot (#1268) 0b63f51fb fixes 1215: execute_process(COMMAND mkdir ${DIR}) fails to create a directory with cmake on Windows (#1219) 3981345be Small nits (#1280) 2a2ebb6f5 Move LRUCache structs to lru_cache.h header 2fc2fd92a Single Delete Mismatch and Fallthrough statistics 3771e3797 WriteBatch support for range deletion 236756f2c Make SyncPoint return immediately when disabled 64a0082c6 Fix DBSSTest::AddExternalSstFileSkipSnapshot valgrind fail dd7a748cf Fix java build 4fe12baa6 Make db_bench less space for --stats_per_interval 6525ce4ca Compaction stats printing: "batch" => "commit group" a117891b4 Fixed typo (#1279) b248e98cf Fix a destruction order issue in ThreadStatusUpdater deda159b5 Added min/max/avg data block size output to sst_dump e408e98c8 add Name() to Cache a297643f2 Fix valgrind memory leak d11c09d9e Eliminate memcpy from ForwardIterator d36755502 Added further Java API options for controlling concurrent writes ebdfe34cc Exposed further Java API options for controlling compaction d1be59463 Improve documentation of SliceTransform. 6056d6317 Improve comment and bug fix for GetOptionsFromMap functions in convenience.h 76a67cf74 support stackableDB as the baseDB of transactionDB 67c1ae883 Travis build break fix b693ba68b Minor PinnedIteratorsManager Refactoring db3dfb164 Fixes for arcanist config (#1271) 87c91bd87 Persistent Read Cache (8) Benchmark tooling 2914de64e add sim_cache stats to Statistics 8b79422b5 [Proof-Of-Concept] RocksDB Blob Storage with a blob log file. 4beffe001 Fix test data race in two FaultInjectionTest tests 821bcb0b3 util/arena.cc: FreeBSD: More portable use of mmap(MAP_ANON) (#1254) 5370f44a8 Increase RocksDB version 56dd03411 read_options.background_purge_on_iterator_cleanup to cover forward iterator and log file closing too. ccecf3f4f UniversalCompaction should ignore sorted runs being compacted (when compacting for file num) 1b0069ce2 Remove non-gtest from parallelized tests 638c49f24 Change HISTORY.md for release 4.11 6b8e9c68b fix vs generator (#1269) c38b075e7 Update HISTORY.md 8f399e3fe Update HISTORY.md 98d0b78ea Added check_snapshot option in the DB's AddFile function (#1261) 9fd68b7fb set travis open file descriptor limit 59ddb5059 Fix travis build break f4d986364 Added SetOptions support to RocksJava (#1243) 7882cb977 Make DBOptionsTest::EnableAutoCompactionAndTriggerStall less falky 44f5cc57a Add time series database (resubmitted) 7c4615cf1 A utility function to help users migrate DB after options change 5bb0a7f73 Update appveyor.…
aead40417 fix HISTORY.md typo a0cdc3cec Bump version to 5.8.7 7513f6350 Fix IOError on WAL write doesn't propagate to write group follower 9e47084ce Bump version to 5.8.6 36074ba5d Enable cacheline_aligned_alloc() to allocate from jemalloc if enabled. aa00523e0 Add -DPORTABLE=1 to MSVC CI build cf2b98237 Bump version to 5.8.5 e8c9350f2 Blob DB: not using PinnableSlice move assignment 4907d2463 Bump version to 5.8.4 5d928c795 Blob DB: Fix race condition between flush and write 725bb9d66 Blob DB: Fix release build b7367fe84 Bump version to 5.8.3 13b2a9b6f Blob DB: use compression in file header instead of global options 5dc70a15c Fix PinnableSlice move assignment 9019e9125 dynamically change current memtable size 7f1815c37 Bump version to 5.8.2 2584a18ef Blob DB: Fix BlobDBTest::SnapshotAndGarbageCollection asan failure 17f67b546 PinnableSlice move assignment 6fb56c582 Blob DB: Add compaction filter to remove expired blob index entries f90ced92f Blob DB: fix snapshot handling 632f36dcd Blob DB: option to enable garbage collection 11bacd578 Blob DB: Fix flaky BlobDBTest::GCExpiredKeyWhileOverwriting test f98efcb1e Blob DB: Evict oldest blob file when close to blob db size limit c1e99eddc Blob DB: cleanup unused options ffc3c62ca Blob DB: Initialize all fields in Blob Header, Footer and Record structs 9e8254090 Blob DB: update blob file format d66bb21e1 Blob DB: Inline small values in base DB 05d5c575a Return write error on reaching blob dir size limit 2b8893b9e Blob DB: Store blob index as kTypeBlobIndex in base db 419b93c56 Blob DB: not writing sequence number as blob record footer 8afb0036c fix lite build dded348dd Blob DB: Move BlobFile definition to a separate file 374736123 add GetLiveFiles and GetLiveFilesMetaData for BlobDB 8cff6e945 Enable WAL for blob index c29347290 Add ValueType::kTypeBlobIndex eae53de3b Make it explicit blob db doesn't support CF 65aec19df Fix memory leak on blob db open 30b38c98c TableProperty::oldest_key_time defaults to 0 2879f4beb Bump version to 5.8.1 88595c882 Add DB::Properties::kEstimateOldestKeyTime 266ac245a Bumping version to 5.8 64185c23a update HISTORY.md for DeleteRange bug fix e83d6a02e Not using aligned_alloc with gcc4 + asan 0980dc6c9 Fix wrong smallest key of delete range tombstones b76797231 avoid use-after-move error c41744270 CMake: Fix formatting c21ea8f7a CMake: Add support for CMake packages 544434558 add Erlang to the list of language bindings 2972a702a Minor updates to FlushWAL blog fbfa3e7a4 WriteAtPrepare: Efficient read from snapshot list b01f426f5 Blog post for FlushWAL 503db684f make blob file close synchronous 3c840d1a6 Allow DB reopen with reduced options.num_levels 92bfd6c50 Fix DropColumnFamily data race 7fdf735d5 Pinnableslice examples and blog post 7fbb9ecca support disabling checksum in block-based table 19cc66dc4 fix clang bug in block-based table reader 7eba54eb9 test compaction input-level split range tombstone assumption cd26af347 Add unit test for WritePrepared skeleton a12479819 Improved transactions support in C API c10b39131 LANGUAGE-BINDINGS.md: add another rust binding 90177432e Remove leftover references to phutil_module_cache 234f33a3f allow nullptr Slice only as sentinel ccf7f833e Use PinnableSlice in Transactions 1dfcdb15f Extend pin_l0 to filter partitions 39ef90055 stop calling memcmp with nullptrs 78cb6b611 Provide byte[] version of SstFileWriter.merge to reduce GC Stall 867fe92e5 Scale histogram bucket size by constant factor f004307e9 CMake improvements 09ac6206a Circumvent ASAN false positive 5b68b114f Blob db create a snapshot before every read 4624ae52c GC the oldest file when out of space 8ace1f79b add counter for deletion dropping optimization 0d8e992b4 Revert the mistake in version update 5358a8056 add VerifyChecksum to HISTORY.md ed0a4c93e perf_context measure user bytes read 1efc600dd Preload l0 index partitions bddd5d363 Added mechanism to track deadlock chain c1384a707 fix db_stress uint64_t to int32 cast 29877ec7b Fix blob db crash during calculating write amp 8f2598ac9 Enable Cassandra merge operator to be called with a single merge operand 9a44b4c32 Allow merge operator to be called even with a single operand ac8fb77af fix some misspellings 23593171c minor improvements to db_stress af012c0f8 fix deleterange with memtable prefix bloom 1c8dbe2aa update scores after picking universal compaction eb6425303 Update WritePrepared with the pseudo code 132306fbf Remove PartialMerge implementation from Cassandra merge operator 71598cdc7 Fix false removal of tombstone issue in FIFO and kCompactionStyleNone 3204a4f64 Fix missing stdlib include required for abort() 7aa96db7a db_stress rolling active window dfa6c23c4 Update RocksDBCommonHelper to use escapeshellarg e367774d1 Overload new[] to properly align LRUCacheShard ad42d2fcb Remove residual arcanist_util directory 279296f4d properly set C[XX]FLAGS during CMake configure-time checks c5f0c6cc6 compile with correct flags to determine SSE4.2 support 185ade4c0 cmake: support more compression type 5449c0990 rocksdb: make buildable on aarch64 a144a9782 Fix for CMakeLists.txt on Windows for RocksJava acf935e40 fix deletion dropping in intra-L0 8254e9b57 make sst_dump compression size command consistent 74f18c130 db_bench support for non-uniform column family ops 5de98f2d5 approximate histogram stats to save cpu 3f5888430 Fix c_test ASAN failure e5a1b727c Fix blob DB transaction usage while GC 6f051e0c7 fix corruption_test valgrind ac098a462 expose set_skip_stats_update_on_db_open to C bindings 666a005f9 Support prefetch last 512KB with direct I/O in block based file reader ad77ee0ea Revert "Makefile: correct faligned-new test" b87ee6f77 Use more keys per lock in daily TSAN crash test 25df24254 Add column families related functions (C API) 64f848435 block_cache_tier: fix gcc-7 warnings 0cecf8155 Write batch for `TransactionDB` in C API 6a9de4347 Windows.h macro call fix 23c7d1354 fix comment 1fbad84b6 Makefile: correct faligned-new test 7848f0b24 add VerifyChecksum() to db.h 47ed3bfc3 fix WinEnv assertions d97a72d63 Try to repair db with wal_dir option, avoid leak some WAL files 36375de76 gcc-7/i386: markup intentional fallthroughs bdc056f8a Refactor PessimisticTransaction a9a4e89c3 Fix valgrind complaint about initialization 4ca11b4b0 Update USERS.md c9804e007 Refactor TransactionDBImpl 20dc5e74f Optimize range-delete aggregator call in merge helper. 0d4a2b733 Avoid blob db call Sync() while writing 627c9f1ab Don't add -ljemalloc when DISABLE_JEMALLOC is set dce6d5a83 db_bench background work thread pool size arguments 4f81ab38b Makefile: fix for GCC 7+ and clang 4+ 92afe830f Update all blob db TTL and timestamps to uint64_t 5883a1ae2 Fix /bin/bash shebangs cc01985db Introduce bottom-pri thread pool for large universal compactions 0b814ba92 Allow concurrent writes to blob db 2c45ada4c Blob DB garbage collection should keep keys with newer version 58410aee4 Fix the overflow bug in AwaitState c3d5c4d38 Refactor TransactionImpl 060ccd4f8 support multiple CFs with OPTIONS file 345387067 Fix statistics in RocksJava sample 1900771bd Dump Blob DB options to info log 3218edc57 Fix universal compaction bug 6a36b3a7b fix db get/write stats a84cee812 Add a missing "once" in .h 21696ba50 Replace dynamic_cast<> e85f2c64c Prevent empty memtables from using a lot of memory ac748c57e Fix FIFO Compaction with TTL tests aaf42fe77 Move blob_db/ttl_extractor.h into blob_db/blob_db.h aace46516 Fix license headers in Cassandra related files 50a969131 CacheActivityLogger, component to log cache activity into a file 6083bc79f Blob DB TTL extractor 710411aea fix asan/valgrind for TableCache cleanup 3a3fb00b7 TARGETS file not setting sse explicitly fca4d6da1 Build fewer tests in Travis platform_dependent tests 8f553d3c5 remove unnecessary internal_comparator param in newIterator 7f6d012d7 "ccache -C" in Travis d12691b86 move TableCache::EraseHandle outside of db mutex f33f11368 fix db_bench argument type e7697b8ce Fix LITE unit tests 3ce20e985 Fix use of RocksDBCommonHelper in cont_integration.sh c281b4482 Revert "CRC32 Power Optimization Changes" 9980de262 Fix FIFO compaction picker test 2289d3811 CRC32 Power Optimization Changes 30b58cf71 Remove the orphan assert on !need_log_sync fe1a5559f Fix flaky write_callback_test addbd279c 5.6.1 release blog post 30edff308 buckification: remove explicit `-msse*` compiler flags 2b259c9d4 Lower num of iterations in DeadlockCycle test 277f6f23d Release note for partitioned index/filters 5e731a138 Remove unused rocksdb arcanist lib 9b11d4345 Fix broken links 06f191744 add vcpkg as an windows option ea8ad4f67 Fix compaction div by zero logging 34112aeff Added db paths to c 1d8aa2961 Gcc 7 ParsedInternalKey replace memset with clear function. a4c42e800 Fix UBSAN issue of passing nullptr to memcmp 16e038820 LRUCacheShard cache line size alignment 216644c61 enable UBSAN macro in TARGETS e67b35c07 Add Iterator::Refresh() a34b2e388 Fix caching of compaction picker's next index 72502cf22 Revert "comment out unused parameters" 1d7048c59 comment out unused parameters 534c255c7 Cassandra compaction filter for purge expired columns and rows 63163a8c6 Remove make_new_version.sh 0302da47a Reduce blob db noisy logging 3e5ea29a8 Fix Flaky DeleteSchedulerTest::ImmediateDeleteOn25PercDBSize a22b9cc6f overlapping endpoint fixes in level compaction picker ffd2a2eef delete ExpandInputsToCleanCut failure log 3e6e863b1 Remove arcanist_util directory 36651d14e Moving static AdaptationContext to outside function 6e3ee015f Update java/rocksjni.pom ecff9d5e3 Include write_buffer_manager in ImmutableDBOptions::Dump ae28634e9 Remove some left-over BSD headers 33b1de82a Remove format compatibility hack 2f375154e checkout local branch in check_format_compatible.sh ddb22ac59 avoid collision with master branch in check format 0c03a7f17 set the remote for git checkout 7ac184c6d Revert cmake -DNDEBUG for non-MSVC 0655b5858 enable PinnableSlice for RowCache 00464a314 Fix column_family_test with LITE build b2dd192fe tools/write_stress.cc: Correct "1204" typos. cbaab3044 table/block.h: change memset f1a056e00 CodeMod: Prefer ADD_FAILURE() over EXPECT_TRUE(false), et cetera 4a2e4891f Add back the LevelDB license file a7321fc97 Remove the licensing description in CONTRIBUTING.md 3c327ac2d Change RocksDB License 132013366 Make TARGETS file portable ccf5f08f8 Set CACHE_LINE_SIZE for s390, PPC, ARM64 67510eeff db_crashtest.py: remove need for shell 4267eb00d Remove punit tests 5bfb67d90 Enable write rate limit for updaterandom benchmark 20a691d98 Update HISTORY to release 5.7 98d1a5510 db_bench to by default verify checksum 26ce69b19 Update blob db to use ROCKS_LOG_* macro 43e4eef77 remove unnecessary fadvise 21b17d768 Fix BlobDB::Get which only get out the value offset 70440f7a6 Add virtual func IsDeleteRangeSupported 7550255c5 Add JAVAC_ARGS as Makefile variable 7a0b5de77 Gcc 7 ignored quantifiers 000bf0af3 Improve the design and native object management of Stats in RocksJava 269d383d5 Bump version to 5.7 c32f27223 Fixes db_bench with blob db fcd99d27c db_bench_tool: fix buffer size 87128bd5c fix regression test 8f927e5f7 Fix undefined behavior in Hash 643b787c7 Added a note about LZ4 compression dependency 56656e12d Temporarily disable FIFOCompactionWithTTLTest b5fb85ec5 fix valgrind init complaint 657df29ea Add max_background_jobs to db_bench a43c053ad remove duplicated utilities/merge_operators/cassandra/test_utils.cc in src.mk 7c4a9e6c9 Initialize a variable in ldb to make code analysis tool happy 98669b535 init filters_in_partition_ 0013bf14e fix asan and valgrind leak report in test 521b4c28b rocksdb 5.5.1 release post 33042573d Fix GetCurrentTime() initialization for valgrind f6b9d9355 Fix clang error in PartitionedFilterBlockBuilder 45b9bb033 Cut filter partition based on metadata_block_size f4ae1bab0 update history for OnBackgroundError and DeleteRange fix 1cb8c6de6 Add -enable_pipelined_write to db_bench and add two defaults 7604b463b Update the AddDBStats in LITE 1e34d07e1 Simplify and document sync rules for logs_ etc d310e0f33 Regression test for empty dedicated range deletion file e9f91a517 Add a fetch_add variation to AddDBStats c1b375e96 skip generating empty sst 67b417d62 fix format compatible test afbef6518 Bug fix: Fast CRC Support printing is not honest 397ab1115 Improve Status message for block checksum mismatches 18c63af6e Make "make analyze" happy 01534db24 Fix the reported asan issues 1cd45cd1b FIFO Compaction with TTL 982cec22a Fix TARGETS file tests list b49b37109 allow numa >= 2.0.8 e517bfa2c CLANG Tidy dc3d2e4d2 update compatible test 89468c01d Fix Windows build broken by 5c97a7c0664d4071768113814e9ba71fe87e18cf 51778612c Encryption at rest support 7061912c2 Trivial typo in HISTORY.md 2a9cd8799 Fix jni WriteBatchThreadedTest 0025a3640 revert perf_context and io_stats to __thread 5c97a7c06 Unit Tests for sync, range sync and file close failures 4cee11f4e Intra-L0 blog post 857e9960b Improve the error message for I/O related errors. d757355cb Fix bug that flush doesn't respond to fsync result 8e6345d2d Update rename of ParanoidCheck 499ebb3ab Optimize for serial commits in 2PC 0ac4afb97 Sanitize partitioning options 521724ba8 fixed wrong type for "allow_compaction" parameter 71f5bcb73 Introduce OnBackgroundError callback 88cd2d96e Downgrade option sanitiy check level for prefix_extractor 6837a1762 Fix Data Race Between CreateColumnFamily() and GetAggregatedIntProperty() af1746751 WriteBufferManager will not trigger flush if much data is already being flushed 9467eb614 Fix flush assertion with tsan 048446fc7 Fix cassandra ASAN use-after-free a21db161c Implement ReopenWritibaleFile on Windows and other fixes c430d69ee fix coredump for release nullptr 0d278456c default implementation for InRange cbd825dee Create a MergeOperator for Cassandra Row Value 2c98b06bf Remove pin_slice option by making it the default c80c6115d add db_bench options for partitioning 6a3377f45 Synchronize statistic enumeration values between statistics.h and java API 53dda8797 Do not run RateLimiterTest.Rate test on Travis+Mac OSX. ae8571f5c Fix blob db compression bug 7a380deff Update blob_db_test 89ad9f3ad Allow ignoring unknown options when loading options from a file 6b5a5dc5d fixed typo 0f228be3b fixed typo in util/dynamic_bloom.h c217e0b9c Call RateLimiter for compaction reads 91e2aa3ce write exact sequence number for each put in write batch 6f4154d69 record index partition properties 5d5a28a98 Fix Clang release build broken by 5582123dee8426a5191dfd5e846cea8c676c793c 0175d58c3 Make direct I/O write use incremental buffer 7a270069b GNU C library for struct tm has 2 additional fields. d713471da Limit trash directory to be 25% of total DB 9bb91e932 Dedup release 27b450165 Update HistogramTypes in the Java API e97304c68 update history for 5.6 5582123de Sample number of reads per SST file db818d2d1 Fix RocksDB Lite build with CLANG a472c4ae4 update 5.5 change log bc09c8a0d Fix crash in PosixWritableFile::Close() when fstat() fails 6d0f22e42 Fix mock_env.cc uninitialized variable c2012d488 Java APIs for put, merge and delete in file ingestion 85dace2af Disable DBRangeDelTest::TailingIteratorRangeTombstoneUnsupported for ubsan d4f7731b6 fix travis error with init time in mockenv 550a1df72 Fix clang errors by asserting the precondition cc5f9339e Fix concurrency issue with filter_block_set_ 2e64f450d bump version to 5.6 afbc2d0d2 Force travis to build with clang on MacOS b172a3f1a Fix warnings while generating RocksJava documentation 52a7f38b1 WriteOptions.low_pri which can throttle low pri writes if needed 26a8a8071 Switch from CentOS 5 to CentOS 6 for crossbuilding RocksJava dba9f3722 Fix db_write_test clang/windows build failure c7662a44a fixed typo 7e8d95cc0 Fix the Java build which was broken by a4d9c02 7e5fac2c3 remove test dir before exit when current regression is running 7f6c02dda using ThreadLocalPtr to hide ROCKSDB_SUPPORT_THREAD_LOCAL from public… 138b87eae Fix interaction between CompactionFilter::Decision::kRemoveAndSkipUnt… 95b0e89b5 Improve write buffer manager (and allow the size to be tracked in block cache) a4d9c0251 Pass CF ID to MemTableRepFactory f68d88be5 Fix DBWriteTest::ReturnSequenceNumberMultiThreaded data race 215076ef0 Fix TSAN: avoid arena mode with range deletions 3a8a848a5 account for L0 size in estimated compaction bytes 0fae3f5dd codemod: format TARGETS with buildifier [5/5] (D5092623) 872199606 add checkpoint support for single db in regression test 5a9b4d743 Retire memenv https://github.com/facebook/rocksdb/pull/2082 d6019651b sync internal/external TARGETS bbaba51bb Add missing index type to C-API 292edfd51 travis: test with xcode8.3 (OS X 10.12) 0dc3040d5 db: avoid `#include`ing malloc and jemalloc simultaneously 9b3ed8350 fix regression test 9c9909bf7 Support ingest file when range deletions exist ad19eb868 Fixing blob db sequence number handling 51ac91f58 Histogram of number of merge operands 345878a7f update blob_db_test cbc821c25 change regression rebuild to one level 103d0692e Avoid unsupported attributes when not building with UBSAN 5fd04566c travis: reduce the number of travis builders 2d05002b9 RocksDB 5.4.5 release blog post 7eca90f18 Update RocksDB blog authors d03c34497 update comment of GetNextFile f7bb1a006 support merge and delete in file ingestion c2c62ad4e Reorder variables of ReadOptions 7bb1f5d48 Increase of compaction threads should be logged at info level instead of a warning 6c456ecae Clean zstd files 347e16f83 codemod: replace `headers = AutoHeaders.*` with `auto_headers` 0be636bf7 Fix db_bench build break with blob db 135ee6a3f fix tsan crash data race a99fb9928 fix column_family_test asan f41bffb3d travis: clang-3.6 -> clang-4.0 e7612798b update buckifer/TARGETS bb01c1880 Introduce max_background_jobs mutable option 5a2530462 Fix the CMakeLists for RocksJava 41cbb7274 options.delayed_write_rate use the rate of rate_limiter by default. 506803466 range sync should be enabled 02594b5f1 Fix build errors in blob_dump_tool with GCC 4.8 52d9e5f7b Fix column family seconds_up accounting 7d8207f1f Fix errors in clang-analyzer builds 85b8569ae Fix release build on Linux 69ec8356b Allow SstFileWriter to use the rate limiter 6cc9aef16 New API for background work in single thread pool 9d0a07ed5 Fix rocksdb.estimate-num-keys DB property underflow 578fb0b1d Simple blob file dumper ac39d6bec Core-local statistics 3e86c0f07 disable direct reads for log and manifest and add direct io to tests 15ba4d6c4 Address MS Visual Studio 2017 issue with autovector 88c818e43 Replace deprecated RocksDB#addFile with RocksDB#ingestExternalFile 228f49d20 Fix data races caught by tsan 4c9d2b104 remove #include port/port.h in public header file 07bdcb91f New WriteImpl to pipeline WAL/memtable write d746aead1 Suppress clang-analyzer false positive 217b866f4 column_family_test: EnvCounter::num_new_writable_file_ to be atomic 9f839a7f6 keep util/build_version.cc when make clean 7eecd40a4 add emacs tags file - etags 9bbba4fec Remoe unused BlockBasedTable::compaction_optimized_ f5ba131bf Fixed some spelling mistakes 146b7718f Fix mingw compilation with -DNDEBUG a36220ccf fix unity test 0ebdd7057 fixed typo 8032f4cb3 Remove -pie in TSAN 362ba9b02 Release RocksDB 5.5.0 ba685a472 Support ingest_behind for IngestExternalFile 01ab7b528 Add ROCKSDB_LIBRARY_API macro to a few C APIs, to fix windows build cb9392a09 add Transactions and Checkpoint to C API 445f1235b s/std::snprintf/snprintf cd593c283 Fix travis java_test f720796e2 fixed typo a48a62d5b define NDEBUG in CMake non-debug builds 1ca723dbd C API: support pinnable get 2ef15b85d Core-local stats blog post 4f9e69ccf fix log err 11c5d4741 cross-platform compatibility improvements d00433302 Put lib files into suitable path in RPM package 86d549253 Fix build error with blob DB. 254c46800 Fix the RocksJava Release on Windows 7a47b431f Fix .gitignore pattern fa5a15ceb Make sure that zstd is statically linked correctly in the Java static build 3fa9a39c6 Add GetAllKeyVersions API 1a60982a5 Simplified instructions for CentOS a5cc7ecec Facility for cross-building RocksJava using Docker ccd3dddf5 Blog post for partitioned index/filters b145c34d7 Update blog authors bbe9ee7dd core-local array type conversions c2be43430 Build and link with ZStd when creating the static RocksJava build c61e72c42 Add missing files of blob_db to CMake file 3907c94ff Fix ColumnFamilyTest:BulkAddDrop cda5fde2d CoreLocalArray class 93949667c update TARGETS 4e83b8001 title: Bulkoading -> title: Bulkloading d85ff4953 Blob storage pr 492fc49a8 fix readampbitmap tests be421b0b1 portable sched_getcpu calls 0f559abdb Add NO_UPDATE_BUILD_VERSION option to makefile 3a04a254a Flink state 35df23fe8 Fix suite exclisions e7cea86f7 Fixes the CentOS 5 cross-building of RocksJava 259a00eac unbiase readamp bitmap a62096696 port: updated PhysicalCoreID() df035b682 Print compaction_options_universal.stop_style in LOG file 4897eb250 dont skip IO for filter blocks 3f73d54bb Add C API to set max_file_opening_threads option 0b69e5079 Define CACHE_LINE_SIZE only when it's not defined 2cd00773c Add bulk create/drop column family API 40af2381e Object lifetime in cache fdaefa030 travis: add Windows cross-compilation a30a69603 do not read next datablock if upperbound is reached 2d42cf5ea Roundup read bytes in ReadaheadRandomAccessFile 264d3f540 Allow IntraL0 compaction in FIFO Compaction 8c3a180e8 Set lower-bound on dynamic level sizes 7c1c8ce5a Avoid calling fallocate with UINT64_MAX a45e98a5b max_open_files dynamic set, follow up 6b99dbe04 fix memory alignment with logical sector size e7ae4a3a0 Max open files mutable 60847a3b0 port: updated PhysicalCoreID() b551104e0 support PopSavePoint for WriteBatch 498693cf3 Remove orphaned Java classes 5e2ebf2bd travis: add CMake compilation af6fe69e4 Fix an issue of manual / auto compaction data race 6798d1f3b Revert "Delete filter before closing the table" 89833577a Delete filter before closing the table 47a09b0a8 Avoid pinning when row cache is accessed aeaba07b2 Remove an assert that causes TSAN failure. 0b90aa951 Set VALGRIND_VER a2b05210e Make PosixLogger::flush_pending_ atomic da4b2070b Fix WriteBatchWithIndex address use after scope error d616ebea2 Add GPLv2 as an alternative license. 4439b4596 Add documentation license 0ca3ead0c add GetRootDB() in DeleteFilesInRange cdad04b05 Remove double buffering on RandomRead on Windows. e15382c09 Disable two flaky tests 2150cc1f3 fix WritableFile buffer size in direct IO efc361ef7 Add user stats Reset API 6616e4d62 add prefetch to PosixRandomAccessFile in buffered io f6a27d0bc Extract statistics tests into separate file 7eddecce1 support bulk loading with universal compaction 3b4d1b7a4 add <sys/sysmacros.h> to avoid warning with glibc 2.25 e5e545a02 Reunite checkpoint and backup core logic 72c21fb3f call GetRootDB() before cast to DBImpl* in CancelAllBackgroundWork 4c9447d88 Add erase option to release cache 04d58970c AIX and Solaris Sparc Support afff9951e Respect deprecated flag in table options 066cfbacc Adding -noprofile to CMakeLists for Windows cb885bccf set compaction_iterator earliest_snapshot to max if no snapshot 7534ba7bd StackableDB should pass ResetStats() c1fbf91b2 Fixing Solaris Sparc crash due to cached TLS 963eeba48 Revert how check_format_compatible.sh checkout release branches. 97005dbd5 tools/check_format_compatible.sh to cover option file loading too 8f6196788 Add cpu usage to regression benchmarks (4th attempt) df74b775e Limit backups opened 1dd776051 Change L0 compaction score using level size 927bbab25 Revert "Add cpu usage to regression benchmarks (3rd attempt)" 8e84a388e Re-add index_per_partition but as deprecated 1553659d6 Add more recent versions to tools/check_format_compatible.sh 966ebb02f Hide event listeners from lite build 476e80be8 Add cpu usage to regression benchmarks (3rd attempt) c49d70465 Add DB:ResetStats() 0fcdccc33 Blob storage helper methods a6439d797 CMake: compile with -O2 e67f0adf3 enable O2 optimization for lz4 bc3973259 CMake: add support for SSE4.2 7d5f5aa97 Separate compile and link for shared library 071652734 remove warning 6e8d6f429 readahead backwards from sst end ca96654d8 Change Build Env to gcc-5 e9e6e5324 Simplify write thread logic 6799c7e00 Pass in remote as a param to branch creation script 44fa8ece9 change use_direct_writes to use_direct_io_for_flush_and_compaction 13b50358f add space for buggy kernel warning b6b9359ec Fix BYTES_WRITTEN accounting 13369fbd4 Update ShipIt to honor TARGETS updates f2449ce92 Remove .deprecated_arcconfig 415be221c RocksDB Release 5.4 : Update HISTORY.md and build version. 3eab41d7c java dependencies test -s -> use test -d a22ed4eab internal_repo_rocksdb to build Java and RocksDB LITE 9f2cc59ec sync TARGETS file 10d754696 set readahead buffer size from roundup(user_size) + 4k to roundup(use… ba7da434a fix db_stress crash caused by buggy kernel warning 6257837d8 Add ROCKSDB_JAVA_NO_COMPRESSION flag 6a6723ee1 Move MergeOperatorPinning tests to be with other merge operator tests 6a8d5c015 Revert "Report cpu usage using time command" 8f47a9751 File level histogram should be printed per CF, not per DB 9300ef545 Fix shared lock upgrades 1f8b119ed Limit maximum memory used in the WriteBatch representation 97ec8a134 Report cpu usage using time command 20778f2f9 Adding comments to the write path 7124268a0 Reduce the number of params needed to construct DBIter 04abb2b2d FreeBSD only requires WITH_JEMALLOC, not the rest 61730186d dummy diff 360e9960f Summary: Remove .arcconfig 69a5e6461 Deprecate .arcconfig 9690653db Add a verify phase to benchmarks dd8f9e38e Fix compilation for GCC-5 c2954f9b6 Add Travis job to build examples 72fc1e9d0 avoid non-existent O_DIRECT on OpenBSD ff9728701 Refactor compaction picker code 9e7293902 only FALLOC_FL_PUNCH_HOLE when ftruncate is buggy 343b59d6e Move various string utility functions into string_util 1d068f606 Fix CompactRange incorrect buffer release df6f5a377 Move memtable related files into memtable directory 107c5f6a6 CMake: more MinGW fixes d2dce5611 Move some files under util/ to separate dirs c50e3750d Use a human readable size for level report ce64b8b71 Divide db/db_impl.cc 02799ad77 Revert "delete fallocate with punch_hole" e2a7b202c Release note for partition filters af256eb2b build db every monday e5a1372b2 Rework test running script. d659faad5 Level-based L0->L0 compaction a12306fab Add a notice on gflags installation in INSTALL.md 43010a929 Revert "[rocksdb][PR] CMake: more MinGW fixes" a30b75cdc Add buckifier script to github repo 3450ac8c1 CMake: more MinGW fixes 90cfd4645 update IterKey that can get user key and internal key explicitly e2c6c0636 add TimedEnv 9e4453180 Refactor WriteImpl (pipeline write part 1) 6ef8c620d Move auto_roll_logger and filename out of db/ a1c469d71 Add release notes for PinnableSlice 0537f515c fix run_remote with strong quoting 72e600094 fixed misses on Centos library installation instructions 88cc81df5 auto_roll_logger_test to move away from real sleep d25e28d58 replace sometimes-undefined uint type with unsigned int a1d7e487b Add L0 write-amp to compaction level stats b6d609063 CMake: support AVX2 in MinGW bd7d13835 test remote instead run remote in regression test c81a805fe test db existence on the remote host 5fc1e6765 add -rf when remove db in regression test 4ab4049f2 gflags has moved to GitHub 4e0065015 make all DB::Get overloads virtual 6401a8b76 Fix build with MinGW 80fe5b385 disable test: DeleteSchedulerTest.DynamicRateLimiting1 a9c86f51b backup garbage collect shared_checksum tmp files da175f7ec exit with code 2 when there is already a db_bench running in regression test 0ee7f0403 Added missing options to RocksJava c6d04f2ec Option to fail a request as incomplete when skipping too many internal keys 58179ec4a Cleanup of ThreadStatusUtil structures should use the DB's reference f3607640a add ldb build to regression test 8a8c96746 Enable Fast CRC32 for Win64 f9813b853 Added SstFileWriter construtor without explicit comparator to JNI api 8d3cb4f20 Added naming of backup engine threads 67d762379 Expose the stalling information through DB::GetProperty() 0fd574926 delete fallocate with punch_hole 41fe9ad75 Hide usage of compaction_options_fifo from lite build e7731d119 Configure index partition size 69c8d524a Fix jni library name for PowerPC Architecture 34a70859b Fix segmentation fault caused by #1961 8dee8cad9 Enable fifo compaction benchmark to db_bench a5c8b5434 fix a header include 91b5feb37 Fix Windows Build broken by a recent commit 41ccae6d2 Add C API functions (and tests) for WriteBatchWithIndex 88bb6f6bf non_shm CI should run tests on /tmp 8888de2b1 Update .gitignore file in examples 203136e79 Fix Compilation errors when using IBM Java f4fce4751 Fix clang compile error - [-Werror,-Wunused-lambda-capture] a084b26a5 Blog post for releasing 5.2.1 15950fe3a Remove ASSERT_EQ(boolean, ...) 3e56c7e0c make total_log_size_ atomic 909028e21 HISTORY.md for log_size_for_flush in CreateCheckpoint() be723a8d8 Optionally construct Post Processing Info map in MemTableInserter e474df947 db_bench: not need to check mmap for PlainTable 8b0097b49 Readers for partition filter 9ef3627fd Allow checkpointing without flushing 17866ecc3 Allow Users to change customized ldb tools' header in help printing a2a883318 remove deleted option from benchmark.sh 78cb19559 add checkpoint to ldb 4b04addfc updated solution if "make format" command fails 8f5bf0446 Flush triggered by DB write buffer size picks the oldest unflushed CF 6908e24b5 dynamic setting of stats_dump_period_sec through SetDBOption() 93c68b642 change regression bash file with debug mode 21d8c3179 remove LIKELY from public headers 36ad75778 INSTALL: document USE_SSE 9272e12f1 avoid ftruncate twice in buffered io d52f334cb Break stalls when no bg work is happening e66221add fix db_bench rate limiter callsites dbae438a0 Replace "DEPRECATED" comment to "not supported" 995618a82 Support SstFileManager::SetDeleteRateBytesPerSecond() e19163688 Add macros to include file name and line number during Logging d525718a9 cleanup direct io flag in WritableFileWriter 5fa927aa9 Add Xpress and ZSTD CompressionType values to C header 11526252c Pinnableslice (2nd attempt) e5bd8def1 update history.md for fixing the bug that skips keys 1ffbdfd9a Add a new SstFileWriter constructor without explicit comparator ebd5639b6 Add ability to search for key prefix in sst_dump tool e6725e8c8 Fix some bugs in MockEnv 900c62be6 fix compile for VS2015 fe1835617 release 5.3 5dae01947 Revert "Report cpu usage using time command" f2817fb7f avoid ASSERT_EQ(false, ...); 5b11124e3 add max to histogram stats d43adf21b Report cpu usage using time command 18fc1bc0e minor changes for rate limiter test flakiness 12ba00ea6 Reset DBIter::saved_key_ with proper user key anywhere before pass to DBIter::FindNextUserEntry c9df05d1e Fix random access alignment f64991537 Add Bulkoading IngestExternalFile blog post 54b434110 Builders for partition filter 97edc72d3 Add a memtable-only iterator 72202962f fix db_sst_test flakiness 5f65dc877 Expose DB::DeleteRange and WriteBath::DeleteRange in Java 58b12dfe3 Set logs as getting flushed before releasing lock, race condition fix f8a4ea020 Move db_test and external_sst_file_test out of Travis's MAC OS run 534581a35 Fix a bug in tests in options operator= a2f7a514d Refactoring 2a5daa06f Add stderr log level for ldb backup commands 4561275c2 fix rate limiter test flakiness 7c80a6d7d Statistic for how often rate limiter is drained 0ad5af42d Clarify VerifyBackup behavior 6fb901344 sanitize readahead when direct read enabled f89b3893c Remove skip_table_builder_flush and default it to true cc253982d Use more default options in db_bench 8432bcf55 Make compaction_pri settable through option string d5b607a43 Make db_wal_test slightly faster ba4c77bd6 Divide external_sst_file_test e877afa08 Remove bulk loading and auto_roll_logger in rocksdb_lite 90d835507 Fix the wrong address for PREFETCH in DynamicBloom::Prefetch 08864df21 Move advanced column family options to advanced_options.h 2ca2059f6 Get unique_ptr to use delete[] for char[] in DumpMallocStats 253799c06 Add missing include for `abort()` c6d464a9d Fixed various memory leaks and Java 8 JNI Compatibility be3e5568b Fix unaligned reads in read cache 8ad0fcdf9 Separate small subset tests in DBTest 6c951c43c Run fewer tests in OSX f7997f134 add direct I/O to version notes 5.2.0 3b8ba703c Fix flaky DBTestUniversalCompaction.UniversalCompactionTrivialMoveTest2 96c7e1504 Fix Java build e0b87afc7 Black list some slow valgrind tests e67232cff Handle failed Finish() in SST file writer 8efb5ffa2 [rocksdb][PR] Remove option min_partial_merge_operands and verify_checksums_in_comp… 1ba2804b7 Remove XFunc tests e7d902e69 add direct_io and compaction_readahead_size in db_stress 1ef5f50e8 detect logical sector size ed50308d2 check backup directory exists before listing children 4d7c06ced Make WriteBatchWithIndex moveble 5040414e6 Gracefully handle previous backup interrupted f206af56f add use_direct_io() to ReadaheadRandomAccessFile 082493442 truncate patch 286a36db7 posix writablefile truncate f0879e4c3 Page size isn't always 4k on linux 18eeb7b90 Fix interference between max_total_wal_size and db_write_buffer_size checks 1560b2f5f Temporarly return deprecated functions to fix MongoRocks build 2a0f3d0de level compaction expansion ebc8a7998 alignment is on in ReadaheadRandomAccessFile::Read() 381fd3224 Remove timeout_hint_us from WriteOptions fce7a6e19 Fail IngestExternalFile when bg_error_ exists a618a16f4 New subcode for IOError to detect the ESTALE errno 7ab005183 Remove deprecated DB::AddFile and DB::CompactRange 401667366 Adding Dlang to the list 756c5924e Allow adding external v1 sst file with no global seqno support aa0298fa9 Remove trailing whitespace from examples Makefile db2b4eb50 avoid direct io in rocksdb_lite 43e9f01c2 Fix repair_test on ROCKSDB_LITE 7106a994f Use monotonic time points in write_controller.cc and rate_limiter.cc c2247dc1c Make DBImpl::has_unpersisted_data_ atomic eb912a927 Remove disableDataSync option 0227c16d6 Update static library versions and add checksums b3aae4d07 Add repair_test to make check 421ce7c2b Add support for JNI Library on Linux on PowerPC. 9afa20cf2 Increase build version and HISTORY.md for releasing 5.2 a5adda064 Fix repair issues b48e4778b Consolidate file cutting logic in compaction loop ac2a77a74 Announce the experimetnal two-level index feature in HISTORY.md c4a37dcb4 Print the missed last layer in cfstats a12818afc Blog post for 5.1.2 release 3b4ac8076 Clarify ldb column family argument d70ce7ee0 Move db_bench flags out of unnamed namespace 186c7eedb Remove incorrect statistics warning 53bb01516 [rocksdb][PR] compaction_style and compaction_pri should output their value as a st… 69d5262c8 Two-level Indexes 0a4cdde50 Windows thread 1aaa898cf Adding GetApproximateMemTableStats method 9fc23c55f Use gcc-4.9-glibc-2.20-fb python in precommit_checker b797e4215 Dump compression dictionary meta-block 036d668b1 Fix wrong result in data race case related to Get() 574b543f8 Rename merger.h -> merging_iterator.h add8b50cc Move ThreadLocal implementation into .cc 71d2496af Fix arc setting for Facebook internal tools f289d9f4a Fix OSX build break after the fallocate change 4a3e7d320 Change the default of delayed slowdown value to 16MB/s 0513e21f9 RangeSync() should work with ROCKSDB_FALLOCATE_PRESENT not set 8b369ae5b Cleaner default options using C++11 in-class init ec79a7b53 Dedup code in option.cc and db_options.cc b96372dea improving the C wrapper 04c4ec41d Change corruption_test to use 4 bits. 2d75cd40d NewLRUCache() to pick number of shard bits based on capacity if not given f25f1ec60 Add test DBTest2.GetRaceFlush which can expose a data race bug 37d4a79e9 Deserialize custom Statistics object in db_bench 3b35134e4 Avoid cache lookups for range deletion meta-block 94a0c32e7 Fix LRU Ref() for handles with external references only 17c118060 Generalize Env registration framework 07dddd5f7 EnvPosixTestWithParam should wait for all threads to finish 5dad9d6d2 Avoid logs_ operation out of DB mutex a7b13919b Fix CompactFiles() bug when used with CompactionFilter using SuperVersion 616a1464e Fix DeleteRange including sentinels in output files c918c4b76 Update USERS.md add user Pika 03ca2ac8a Remove function from DBImpl that are not used anywhere b0029bc7f Test merge op covered by range deletion in memtable d438e1ec1 Test range deletion block outlives table reader fba726e55 Version librocksdb.so 9da4d542f Range deletions unsupported in tailing iterator f2b4939da fixed typo 973f1b78f memtable: delete merge value for range deleteion aebfd1703 fix non-portable behavior in encoder 753ff84a3 Fix get approx size d7ea44f2f Fixup a couple of builds errors on Linux. 537da370d c: allow set savepoint to writebatch af6ec4d78 fix batchresult handle leak e29bb934f Zlib 1.2.8 is no longer available, switched to 1.2.10 5ac97314e Fix std::out_of_range when DBOptions::keep_log_file_num is zero 4e35ffdfa cmake: check -momit-leaf-frame-pointer before using it 3c0852d1d Make ingest external file backward compatible 0e8dfd606 Fix OptimizeForPointLookup() e840213d6 Change DB::GetApproximateSizes for more flexibility needed for MyRocks 9239103cd Flush job should release reference current version if sync log failed da54d36a9 Disable IngestExternalFile in ReadOnly mode 5cf176ca1 Fix for 2PC causing WAL to grow too large 4a73bb0b4 Split travis jobs c70d3c7ad Enable DBTest.GroupCommit as it runs in a reasonlable time now. 602c13a96 Remove fadvise with direct IO read f9d18e22d Fix DeleteRange file boundary correctness issue with max_compaction_bytes 3ce091fd7 Add KEEP_DB env var option 77b480662 Fix 2PC with concurrent memtable insert e8a096000 util/thread_local.h: silence a clang-build warning 324a0f988 Follow up for DirectIO refactor bc5d7b702 travis: For linux, do all tests under gcc 3e6899d11 change UseDirectIO() to use_direct_io() d4e07a845 fix warning of unused direct io helper functions dc2584eea direct reads refactor d18dd2c41 Abort compactions more reliably when closing DB 62384ebe9 Guarding extra fallocate call with TRAVIS because its not working pro… 9f246298e Performance: Iterate vector by reference fe395fb63 Allow incrementing refcount on cache handles 2172b660e Fix build on FreeBSD 3c233ca4e Fix Windows environment issues 763173456 Fix the error in ColumnFamiliesTest 7a02ad070 Update travis to ubuntu trusty 60c509ff1 Fix valgrind failure in test CurrentFileModifiedWhileCheckpointing2PC d0ba8ec8f Revert "PinnableSlice" 54d94e9c2 PinnableSlice e04480fae Fix MS warnings. Use ROCKSDB_Prsz for size_t. c081f7215 5.0.1 release blog post ac73d7558 Add GetSupportedCompressions() convenience function b104b8781 Maintain position in range deletions map 640d72480 Update db_bench and sst_dump to test with block cache mid-point inser? 653ac1f9c C API: support total_order_mode 85ac1a320 Fix rocksdb::Status::getState 76711b6e7 Make ExternalSSTFileTest::CompactionDeadlock more deterministic c963460db Fix tests under GCC_481 33c86d677 Fix backupable db test e425ec116 utilities/backupable: backup should limit the copy size of wal. 0712d541d Delegate Cleanables d58ef52ba Allow SstFileWriter to Fadvise the file away from page cache 17a4b75cc Always fsync the file after file copying 2fb70dc79 examples: Add options_file_example to target all a738af8f8 db/pinned_iterators_manager.h: bugfix 906523d98 Add description to the 2PC checkpooint bug in HISTORY.md 438f22bc5 Fix bug of Checkpoint loses recent transactions with 2PC 335981d47 Fix the directory path for RocksDB repo 548b62805 Enable conditionally using adaptive mutexes 4e07b08ef include/rocksdb/utilities/env_librados: fix typo ab48c165a Print cache options to info log 972f96b3f direct io write support 989e644ed Remove sst_file_manager option from LITE 1beef6569 Fix c_test 3d692822f persistent_cache: fix two timer 046099c9b The array is malloced by backtrace_symbols(), and must be freed 6ff2c8d7f Remove gflags as travis build dependency 3cd9ed1c3 Show sandcastle URL in phabricator 50e305de9 Collapse range deletions 5d1457dbb Dump persistent cache options 7bd725e96 db_bench: introduce --benchmark_read_rate_limit 296691847 Update Netflix section of USERS.md 342370f1d Simplify MemTable::Update 1a136c1f1 Expose file size fbff4628a Reduce compaction iterator status checks bd6cf7b51 WritableFileWriter: default buffer size equal min(64k,options.writabl? fc0c6fd98 "make format" format diff since last commit from master 816c1e30c gcc-7 requires include <functional> for std::function c27073586 Iterator should be in corrupted status if merge operator return false a8bf4d63f Make format shows wrong curl command for retrieving clang-format-diff.py 8f5d24ae6 C API: support get usage and pinned_usage for cache 0ab6fc167 Gcc-7 buffer size insufficient b7239bf7e Gcc 7 fallthrough 477b6ea57 std::remove_if requires <algorithm> 83f9a6fd2 Fail BackupEngine::Open upon meta-file read error a79eae4b0 Add pcache documentation images d71e728c7 Print user collected properties in sst_dump 7004a6f7b Add missing copyright header 3cdfaeca3 Fixes for MSVC compilation e097222e6 util/logging.cc: buffer of insufficient size (gcc-7 -Werror=format-length) cfc34d7c4 Missing break in case in DBTestBase::CurrentOptions bfbcec233 Gcc 7 error expansion to defined 6653e32ac build: make it easier to pass PORTABLE 67adc937b intentional fallthough (prevents gcc-7/clang-4 error) 1a146f89c break Flush wait for dropped CF c3e5ee715 util/histogram.cc: HistogramStat::toString buffer insufficient 5334d8b44 table/block_based_table_builder.cc: intentional fallthrough - comment to match gcc pattern 36d42e65d Disable test to unblock travis build b57dd9262 C API: support writebatch delete range 2ba59b5a1 Disallow ingesting files into dropped CFs 1f6f7e3e8 cast to signed char in ldb_cmd_test for ppc64le 243975d5d More accurate error status for BackupEngine::Open f0c509e2c Return finer-granularity status from Env::GetChildren* dc64f46b1 Add db_bench option for stderr logging 2cabdb8f4 Increase buffer size 4a17b47bb Remove unnecessary header include 8c2b921fd Fixed a crash in debug build in flush_job.cc 20ce081fa Fix issue where IngestExternalFile insert blocks in block cache with g_seqno=0 5241e0dbf fix db_bench argument type c04f6a0b4 Specify shell in makefile 45c7ce137 CompactRangeOptions C API 2c2ba6824 db_stress support for range deletions b821984d3 DeleteRange read path end-to-end tests 2f4fc539c Compaction::IsTrivialMove relaxing 1dce75b2e Update USERS.md 304b3c706 Update USERS.md fa50fffaf Option to expand range tombstones in db_bench c26a4d8e8 Fix compile error in trasaction_lock_mgr.cc ed8fbdb56 Add EventListener::OnExternalFileIngested() event 2005c88a7 Implement non-exclusive locks 0b0f23572 Mention IngestExternalFile changes in HISTORY.md 23db48e8d Update HISTORY.md for 5.0 branch beb36d9c1 Fixed CompactionFilter::Decision::kRemoveAndSkipUntil 67f37cf19 Allow user to specify a CF for SST files generated by SstFileWriter 9053fe2a5 Made delete_obsolete_files_period_micros option dynamic edde954e7 fix clang build 56281f3a9 Add memtable_insert_with_hint_prefix_size option to db_bench 4a21b1402 Cache heap::downheap() root comparison (optimize heap cmp call) e39d08087 Fix travis (compile for clang < 3.9) 3f407b065 Kill flashcache code in RocksDB b77007df8 Bug: paralle_group status updated in WriteThread::CompleteParallelWorker 247d0979a Support for range skips in compaction filter 96fcefbf1 c api: expose option for dynamic level size target 00197cff3 Add C API to set base_backgroud_compactions 5b219eccb deleterange end-to-end test improvements for lite/robustness aad119176 pass rocksdb oncall to mysql_mtr_filter otherwise tasks get created w… e33352899 DeleteRange write path end-to-end tests 7784980fc Fix mis-reporting of compaction read bytes to the base level 3c6b49ed6 Fix implicit conversion between int64_t to int b3b875657 Remove unused assignment in db/db_iter.cc 4f6e89b1d Fix range deletion covering key in same SST file a2bf265a3 Avoid intentional overflow in GetL0ThresholdSpeedupCompaction 52fd1ff2c disable UBSAN for functions with intentional -ve shift / overflow 1886c435b Fix CompactionJob::Install division by zero 63c30de80 fix options_test ubsan 13e66a8f5 Fix compaction_job.cc division by zero 01eabf737 Fix double-counted deletion stat 7ffb10fc1 DeleteRange compaction statistics 236d4c67e Less linear search in DBIter::Seek() when keys are overwritten a lot cd7c4143d Improve Write Stalling System dfb6fe675 Unified InlineSkipList::Insert algorithm with hinting 3068870cc Making persistent cache more resilient to filesystem failures 734e4acaf Eliminate redundant cache lookup with range deletion 182b940e7 Add WriteOptions.no_slowdown 4118e1333 Persistent Cache: Expose stats to user via public API f2a8f92a1 rocks_lua_compaction_filter: add unused attribute to a variable 4444256ab Remove use of deprecated LZ4 function 548d7fb26 Fix fd leak when using direct IOs fd43ee09d Range deletion microoptimizations 23a18ca5a Reword support a little bit to more clear and concise 481856ac4 Update support to separate code issues with general questions a0deec960 Fix deadlock when calling getMergedHistogram fe349db57 Remove Arena in RangeDelAggregator e63350e72 Use more efficient hash map for deadlock detection a13bde39e Skip ldb test in Travis 73843aa63 Direct I/O Reads Handle the last sector correctly. 9d60151b0 Implement PositionedAppend for PosixWritableFile 3f6221521 Lazily initialize RangeDelAggregator's map and pinning manager 41e77b839 cmake: s/STEQUAL/STREQUAL/ c1038d283 Release RocksDB 5.0 635a7bd1a refactor TableCache Get/NewIterator for single exit points f39452e81 Fix heap use after free ASAN/Valgrind a4eb7387b Allow plain table to store index on file with bloom filter disabled 36e4762ce Remove Ticker::SEQUENCE_NUMBER 86eb2b9ad Fix src.mk 0765babe1 Remove LATEST_BACKUP file 647eafdc2 Introduce Lua Extension: RocksLuaCompactionFilter 760ef68a6 fix deleterange asan issue 327085b7b fix valgrind 715591bba Ask travis to use JDK 7 972e3ff29 Enable allow_concurrent_memtable_write and enable_write_thread_adaptive_yield by default 420bdb42e option_change_migration_test: force full compaction when needed 1543d5d92 Report memory usage by memtable insert hints map. 018bb2ebf DeleteRange support for db_bench dc51bd716 CMakeLists.txt: FreeBSD has jemalloc as default malloc 48e8baebc Decouple data iterator and range deletion iterator in TableCache 4b0aa3c4c Fix failed compaction_filter_example and add it into make all 53b693f5f ldb support for range delete 661e4c926 DeleteRange unsupported in non-block-based tables 489d14280 DeleteRange interface eba99c28e Fix min_write_buffer_number_to_merge = 0 bug 2ef92fea5 Remove all instances of relative_url until GitHub pages problem is fixed. 91300d01f Dynamic max_total_wal_size option ec2f64794 Consider subcompaction boundaries when updating file boundaries for range deletion 800e51553 Fix CSS issues again b952c898b Parallize persistent_cache_test and transaction_test 3b192f618 Handle full final subcompaction output file with range deletions 6c5795200 Make range deletion inclusive-exclusive 425210cc4 CSS issues are arising on the Github Pages side. Temp fix. 1ea79a78c Optimize sequential insert into memtable - Part 1: Interface df5eeb85c Optimize sequential insert into memtable - Part 2: Implementation 5ed650857 Fix SstFileWriter destructor adb665e0b Allowed delayed_write_rate option to be dynamically set. 307a4e80c sst_dump support for range deletion 361010d44 Exporting compaction stats in the form of a map 672300f47 Use relative Urls for stylesheets b39b2ee12 do not call get() in recovery mode 1ca5f6d13 Fix 2PC Recovery SeqId Miscount e095d0cbc Rocksdb contruns to new Sandcastle API 14c0380e7 Convenience option to parse an internal key on command line c90fef88b fix open failure with empty wal 4e20c5da2 Store internal keys in TombstoneMap a9fb346e4 Fix RocksDB Lite build failure in c_test.cc d133b08f6 Use correct sequence number when creating memtable 144cdb8f1 16384 as e.g .value for compression_max_dict_bytes 9bd191d2f Fix deadlock between (WriterThread/Compaction/IngestExternalFile) a9fae0a9d CSS problems again :( 193221e0a Fix Forward Iterator Seek()/SeekToFirst() e48f3f8b9 remove tabs and duplicate #include in c api 85bd8f518 Minor fix to GFLAGS usage in persistent cache a7875272d c: support seek_for_prev 0f17f9279 Make the header links a bit more flexible cf19f559d single quotes in feed 2dc019e09 Fix header links f1aedda06 More Jekyll 3.3 fixes c54cdc378 More Jekyll 3.3 updates 2bcaf8246 Update product and feature template for Jekyll 3.3 24bceb096 Java API - Implement GetFromBatch and GetFromBatchAndDB in WBWI 815f54afa Insert range deletion meta-block into block cache 9e7cf3469 DeleteRange user iterator support 5c5d01ae7 Fix wrong comment (Maximum supported block size) f998c9790 DeleteRange Get support 879f36636 Add C api for RateLimiter 557034f36 Remove all instances of baseurl 437942e48 Add avoid_flush_during_shutdown DB option 2b16d664c Change max_bytes_for_level_multiplier to double 16fb04434 expose IngestExternalFile to c abi ce22ea99a Fix casts for MSVC 196af035c Introduce FAIL_ON_WARNINGS CMake variable (default ON) 40a2e406f DeleteRange flush support d5555d95a Fix MSVC compile error in 32 bit compilation da61f348d Print compression and Fast CRC support info as Header level f9eb56791 db_bench: --dump_malloc_stats takes no effect 6a4faee5c fix freebsd build include path err and so & jar file name c90c48d3c Show More DB Stats in info logs 1b295ac8a DBTest.GetThreadStatus: Wait for test results for longer 25f5742f0 Update documentation to point at gcc 4.8 b50a81a2b Add a test for tailing_iterator 04751d534 L0 compression should follow options.compression_per_level if not empty 2946cadc4 Improve RangeDelAggregator documentation 0a9fd05c2 Update Vagrant file (test internal phabricator workflow) fcd1e0bf6 Make rocksdb work with internal repo 0aab5e55f FreeBSD: malloc_usable_size is in <malloc_np.h> (#1428) 9c0bb7f17 cmake: drop "-march=native" from CXX_FLAGS (#1429) eeb27e1bb Add handy option to turn on direct I/O in db_bench (#1424) c6168d13a removed some declarations from c.h which resulted in undefined symbols (#1407) bc429de49 revert fractional cascading in farward iterator b9bc7a2aa Use skiplist rep for range tombstone memtable 60a2bbba9 Makefile: generate util/build_version.cc from .in file (#1384) 9ee84067f Disable DBTest.RepeatedWritesToSameKey (#1420) f41df3045 OptionChangeMigration() to support FIFO compaction 2e8004e60 Changing the legocastle run to use valgrind_test instead of _check 9de2f7521 revert Prev() in MergingIterator to use previous code in non-prefix-seek mode 24495186d DBSSTTest.RateLimitedDelete: not to use real clock 1168cb810 Fix a bug that may cause a deleted row to appear again 99c052a34 Fix integer overflow in GetL0ThresholdSpeedupCompaction (#1378) f83cd64c0 Fix a bug that mistakenly disable regression_test.sh to update commit (#1415) 0e926b84f Passing DISABLE_JEMALLOC=1 to valgrind_check if run locally 4dfaa6610 Make IsDeadlockDetect() virtual member of Transaction 59a7c0337 Change ioptions to store user_comparator, fix bug 869ae5d78 Support IngestExternalFile (remove AddFile restrictions) 1d9dbef64 Restrict running condition of UniversalCompactionTrivialMoveTest2 4edd39fda Implement deadlock detection 48fd619a4 Minor fixes to RocksJava Native Library initialization (#1287) 48e4e842b Disable auto compactions in memory_test and re-enable the test (#1408) fb2e41294 column_family_test: disable some tests in LITE 5af651db2 fix data race in compact_files_test a0ba0aa87 Fix uninitialized variable gcc error for MyRocks b88f8e87c Support SST files with Global sequence numbers [reland] 08616b493 [db_bench] add filldeterministic (Universal+level compaction) 52c9808c3 not split file in compaciton on level 0 5e0d6b4cc fix db_stress assertion failure ab5399837 Bump RocksDB version to 4.13 (#1405) b4d07123c SamePrefixTest.InDomainTest to clear the test directory before testing aa09d0338 Avoid calling GetDBOptions() inside GetFromBatchAndDB() 6fbe96baf Compaction Support for Range Deletion 257de78d9 Remove "-Xcheck:jni" from Java tests (#1402) d88dff4ef add seeforprev in history 5027dd17a Fix a minor bug in the ldb tool that was not selecting the specified (#1399) fea6fdd67 Fix @see in two Java functions (#1396) b1031d6c1 Remove function local statics that interfere with memory pooling (#1392) f47054015 Handle WAL deletion when using avoid_flush_during_recovery e29d3b67c Make max_background_compactions and base_background_compactions dynamic changeable 21e8daced fix assertion failure in Prev() b9311aa65 Implement WinRandomRW file and improve code reuse (#1388) a249a0b75 check_format_compatible.sh to use some branch which allows to run with GCC 4.8 (#1393) 040328a30 Remove an assertion for single-delete in MergeHelper::MergeUntil 8cbe3e10c Relax the acceptable bias RateLimiterTest::Rate test be 25% f26a139d8 Log successful AddFile 5691a1d8a Fix compaction conflict with running compaction 017de666c fixup commit 1b7af5fb1 Redo handling of recycled logs in full purge 27bfe327b Editorial change to README.md 89cc404de A bit of doc restructuring 9e7fda829 Fix arcanist 2e4b5cab0 Add missing RateLimiter class to the Windows build (#1382) ce4963fdf [doc] Document that Visual Studio 2015+ is now required for Windows builds (#1389) e48927098 Fix scoped arena iterator (#1387) f8d8cf53f Fix log_write_bench -bytes_per_sync option. (#1375) 02b3e3985 Make txn->GetState() const 447f17127 new Prev() prefix support using SeekForPrev() 991b585ee More block cache tickers d6ae6dec6 Add Statistics::getAndResetTickerCount(). aea3ce4c8 Avoid string CONCAT which is not supported in cmake 2.6 (#1383) 2ad68b971 Support running consistency checks in release mode 67501cfc9 Fix -ve std::string::resize 04b02dd12 Testing asset links after config change 8c55bb87c Make Lock Info test multiple column families d06232897 Revert "Support SST files with Global sequence numbers" 5cd28833a [RocksJava] Adjusted RateLimiter to 3.10.0 (#1368) 37737c3a6 Expose Transaction State Publicly 2c1f95291 Add facility to write only a portion of WriteBatch to WAL 043cb62d6 Fix record_size in log_write_bench, swap args to std::string::assign. (#1373) 4985f60fc env_mirror: fix a few leaks (#1363) 5aded67dd update of c.h (#1371) 912aec13c "Recent Posts" -> "All Posts" 7cbb298db Make sure that when contribtuing we call out creating appropriate directories a06ad4711 Add top level doc information to CONTRIBUTING.md 3fdd5b971 A little more generic CONTRIBUTING.md ed4fc31db Add link to CONTRIBUTING.md to main docs README.md e4922e181 Forgot to truncate one blog post 6d8cd7ede Add CONTRIBUTING.md for rocksdb.org contribution guidance bd55e5a1e Fix some formatting of compaction blog post 0f60358b0 CRLF -> LF mod (including removing trailing whitespace for those files) b90e29c90 Truncate posts on the main /blog/ page 0d7acadaf Add author fields to blog posts 01be44181 Add GitHub link to the landing page header 9d6c96138 Fix Mac build ab01da543 Support SST files with Global sequence numbers d346ba246 Minor fixes around Windows 64 Java Artifacts (#1366) e91b4d0cf Add factory method for creating persistent cache that is accessible from public be1f1092c Expose transaction id, lock state information and transaction wait information 6009c473c Store range tombstones in memtable 3c21c64c7 Use size hint for HashMap in multiGet. Similar to https://github.com/facebook/rocksdb/pull/1344 (#1367) 13f7a01f6 Fixing JNI release build for gcc (#975) 7260662b3 Add Java API for SstFileWriter 26388247a delete unused variable for PrevInterval() 87dfc1d23 Fix conflict between AddFile() and CompactRange() eb44ed655 Update 2016-09-28-rocksdb-4-11-2-released.markdown e4437610d Update 2016-09-28-rocksdb-4-11-2-released.markdown 501f05108 Update 2016-09-28-rocksdb-4-11-2-released.markdown dec9009f8 Update 2016-09-28-rocksdb-4-11-2-released.markdown 4ed69dd0b Create 2016-09-28-rocksdb-4-11-2-released.markdown 21f4bb5a8 cmake support for linux and osx (#1358) 4defe306f fix typo in comments (#1360) f517d9dd0 Add SeekForPrev() to Iterator eb3894cf4 Recompute compaction score on SetOptions (#1346) 5c64fb67d Fix AddFile() conflict with compaction output [WaitForAddFile()] 9e9f5a0b9 Fix CompactFilesTest.ObsoleteFiles timeout (#1353) c2a62a4cb not cut compaction output when compact to level 0 9ed928e7a Split DBOptions into ImmutableDBOptions and MutableDBOptions 4bc8c88e6 Recover same sequence id from WAL (#1350) 0a1bd9c50 add cfh deletion started listener da5a9a65c Fix mac build d45eb6c6d Fix typo (#1349) abc0ae462 Add AddFile() InternalStats for Total files/L0 files/total keys ingested 715256338 forbid merge during recovery 5735b3dc2 Fix compiling under -Werror=missing-field-initializers 654ed9a28 loose the assertion condition of rate_limiter_test e4d3f5d9b Fix DBImpl::GetWalPreallocateBlockSize Mac build error 7afbb7420 solve the problem of table_factory_to_write_=nullptr (#1342) d78a4401b DBImpl::GetWalPreallocateBlockSize() should return size_t 42ac9c5f1 Retry getting arcanist token on failure b666f8544 Consider more factors when determining preallocation size of WAL files 4c3f4496b Add TableBuilderOptions::level and relevant changes (#1335) 3edb9461b Avoid hard-coded sleep in EnvPosixTestWithParam.TwoPools 0a88f38b7 Remove ColumnFamilyData::options() 41a9070f8 Fix java makefile dependencies 8d9bf5c49 Fix DBOptionsTest.GetLatestOptions 40cfa3e02 Fix DBWALTest.RecoveryWithLogDataForSomeCFs with mac 06b4785fe Fix recovery for WALs without data for all CFs d7242ff4d Fix GetSortedWalFiles when log recycling enabled 17f76fc56 DB::GetOptions() reflect dynamic changed options 215d12826 Fix typo (#903) a958c2643 Rename jvalue to jval in rocksjni 0a165bd7d Have Facebook link point to RocksDB on FB 3639f3288 Fix bug in UnScSigned-off-by: xh931076284 <931076284@qq.com> (#1336) 8e061f974 Refactor GetMutableOptionsFromStrings 81747f1be Refactor MutableCFOptions ba65c816b Support POSIX RandomRWFile 1d980a8e3 Create CNAME 2adab1dde Add API links to the header bar a182b2981 Preserve blog comments in markdown f54de9230 Adding Dgraph to list of Users (#1291) 9e4aa798c Summary: (#1313) a10e8a056 Fix C api memtable rep bugs. (#1328) eb1d4d53c Release RocksDB 4.12 22d88e24d Allow an offset as well as a length to be specified for byte[] operations in RocksJava JNI (#1264) b06b19136 add C api for set wal_recovery_mode (#1327) 1cca09129 Temporarily revert Prev() prefix support de28a2553 Update HISTORY.md for thread-local stats 0fcb6dbed Remove extraneous function prototypes from c.h (#1326) 52ee07b02 Move AddFile() tests to external_sst_file_test.cc 66a91e260 Add NoSpace subcode to IOError (#1320) 67036c040 Fix Flaky ColumnFamilyTest.FlushCloseWALFiles 0e2da497c fix typo in option.h's comment (#1321) 6d61358a0 Add real Google Analytics ID 2d9d36ea4 Have "Edit on GitHub" point to master instead of gh-pages 937751898 Update landing page content 1ec75ee76 Add redirects from old blog posts link to new format 607628d34 Support ZSTD with finalized format ce1be2ce3 Fix build error on Windows (AppVeyor) (#1315) f7669b40b Fix Windows Build 22696b088 Fix uninitlized CompactionJob::SubcompactionState::current_output_file_size c1865e0f7 Trigger more tests per diff a88677d2c Remove ImmutableCFOptions from public API 80c75593e Fix data race in AddFile() with multiple files + custom comparator bug 5051755e3 Fix db_bench memory use after free (detected by clang_analyze) 4fd08f4b8 Ensure Correct Behavior of StatsLevel kExceptDetailedTimers and kExceptTimeForMutex (#1308) e14fbaae2 Add FAQ based on the front page of the current rocksdb.org 3c2262400 Migrate the RocksDB Worpdress blog over to Jekyll ee0e2201e Transfer the current Getting Started contents to GitHub Pages 5a0e9a4cf Initial Landing Page 9447a8540 Remove the `doc` directory 32149059f Merge options source_compaction_factor, max_grandparent_overlap_bytes and expanded_compaction_factor into max_compaction_bytes 4590b53a4 add stats to Cache::LookUp() 85bb30825 Expose Utility function StringToMap() (#1306) 8ce1b8440 Fix Travis on Mac 380e651af Fix Mac build failure (#1309) 1613fa949 Thread-specific histogram statistics 6a14d55bd add prefix_seek_mode to db_iter_test de47e2bd4 Fix ClockCache memory leak f099af4c7 Fix travis db74b1a21 fix bug in merge_iterator when data race happens b18f9c9ea add nullptr check to internal_prefix_transform 4e395e875 Update docs README.md 2482d5fb4 support Prev() in prefix seek mode 7541c7a79 Fix cache_test valgrind_check failure c8513cde0 Update the download location of Snappy (#1304) b49b92cf2 Introduce Read amplification bitmap (read amp statistics) c7004840d store prefix_extractor_name in table 4ad928e17 add comment to SimCache to estimate actual capacity e9b2af87f Expose ThreadPool under include/rocksdb/threadpool.h 23a057007 Document memtable flush behavior in CancelAllBackgroundWork() dade61ac2 Mitigate regression bug of options.max_successive_merges hit during DB Recovery cce702a6e [db_bench] Support single benchmark arguments (Repeat for X times, Warm up for X times), Support CombinedStats (AVG / MEDIAN) 3586901f8 cat tests logs sorted by exit code b2ce59537 Persist data during user initiated shutdown 4b3438d2d Fix parallel valgrind (valgrind_check) a081f798b Relax consistency for thread-local ticker stats b10d65c2a Update and slightly clarify instructions in build_detect_platform (#1301) f85f99bf6 Fix the Windows build of RocksDB Java. Similar to https://github.com/facebook/rocksdb/issues/1220 (#1284) 7b8109517 Fix a crash when compaction fails to open a file 7c9586837 Thread-specific ticker statistics ea9e0757f Add initial GitHub pages infra for RocksDB documentation move and update. (#1294) 2a9c97108 [Flaky Test] Disable DBPropertiesTest.GetProperty d76ddf327 Disable ClockCache db_crashtest cec2c6436 fix data race in NewIndexIterator() in block_based_table_reader.cc badbff65b Not insert into block cache if cache is full and not holding handle 4a16c32ec Option to cache index/filter blocks with priority 99c4af716 Make ClockCache available with TSAN build f57bc1d03 Fix lambda expression for clang/windows 5440675c3 Fix lambda capture expression for windows 6584cec8f Fold function for thread-local data 817eeb29b Add singleDelete to RocksJava (#1275) ffdf6eee1 Add Status to RocksDBException so that meaningful function result Status from the C++ API isn't lost (#1273) ecf900386 Fix bug in printing values for block-based table 72f8cc703 LRU cache mid-point insertion 6a17b07ca Add TablePropertiesCollector support in SstFileWriter 78837f5d6 TableBuilder / TableReader support for range deletion 4cc37f59e Introduce ClockCache ff17a2abf Adding TBB as dependency. 49d88be02 c abi: allow compaction filter ignore snapshot (#1268) 0b63f51fb fixes 1215: execute_process(COMMAND mkdir ${DIR}) fails to create a directory with cmake on Windows (#1219) 3981345be Small nits (#1280) 2a2ebb6f5 Move LRUCache structs to lru_cache.h header 2fc2fd92a Single Delete Mismatch and Fallthrough statistics 3771e3797 WriteBatch support for range deletion 236756f2c Make SyncPoint return immediately when disabled 64a0082c6 Fix DBSSTest::AddExternalSstFileSkipSnapshot valgrind fail dd7a748cf Fix java build 4fe12baa6 Make db_bench less space for --stats_per_interval 6525ce4ca Compaction stats printing: "batch" => "commit group" a117891b4 Fixed typo (#1279) b248e98cf Fix a destruction order issue in ThreadStatusUpdater deda159b5 Added min/max/avg data block size output to sst_dump e408e98c8 add Name() to Cache a297643f2 Fix valgrind memory leak d11c09d9e Eliminate memcpy from ForwardIterator d36755502 Added further Java API options for controlling concurrent writes ebdfe34cc Exposed further Java API options for controlling compaction d1be59463 Improve documentation of SliceTransform. 6056d6317 Improve comment and bug fix for GetOptionsFromMap functions in convenience.h 76a67cf74 support stackableDB as the baseDB of transactionDB 67c1ae883 Travis build break fix b693ba68b Minor PinnedIteratorsManager Refactoring db3dfb164 Fixes for arcanist config (#1271) 87c91bd87 Persistent Read Cache (8) Benchmark tooling 2914de64e add sim_cache stats to Statistics 8b79422b5 [Proof-Of-Concept] RocksDB Blob Storage with a blob log file. 4beffe001 Fix test data race in two FaultInjectionTest tests 821bcb0b3 util/arena.cc: FreeBSD: More portable use of mmap(MAP_ANON) (#1254) 5370f44a8 Increase RocksDB version 56dd03411 read_options.background_purge_on_iterator_cleanup to cover forward iterator and log file closing too. ccecf3f4f UniversalCompaction should ignore sorted runs being compacted (when compacting for file num) 1b0069ce2 Remove non-gtest from parallelized tests 638c49f24 Change HISTORY.md for release 4.11 6b8e9c68b fix vs generator (#1269) c38b075e7 Update HISTORY.md 8f399e3fe Update HISTORY.md 98d0b78ea Added check_snapshot option in the DB's AddFile function (#1261) 9fd68b7fb set travis open file descriptor limit 59ddb5059 Fix travis build break f4d986364 Added SetOptions support to RocksJava (#1243) 7882cb977 Make DBOptionsTest::EnableAutoCompactionAndTriggerStall less falky 44f5cc57a Add time series database (resubmitted) 7c4615cf1 A utility function to help users migrate DB after options change 5bb0a7f73 Update appveyor.…
6f35cb93 bump version c1565071 update history dd0efa4e Preserve overlapping file endpoint invariant aead4041 fix HISTORY.md typo a0cdc3ce Bump version to 5.8.7 7513f635 Fix IOError on WAL write doesn't propagate to write group follower 9e47084c Bump version to 5.8.6 36074ba5 Enable cacheline_aligned_alloc() to allocate from jemalloc if enabled. aa00523e Add -DPORTABLE=1 to MSVC CI build cf2b9823 Bump version to 5.8.5 e8c9350f Blob DB: not using PinnableSlice move assignment 4907d246 Bump version to 5.8.4 5d928c79 Blob DB: Fix race condition between flush and write 725bb9d6 Blob DB: Fix release build b7367fe8 Bump version to 5.8.3 13b2a9b6 Blob DB: use compression in file header instead of global options 5dc70a15 Fix PinnableSlice move assignment 9019e912 dynamically change current memtable size 7f1815c3 Bump version to 5.8.2 2584a18e Blob DB: Fix BlobDBTest::SnapshotAndGarbageCollection asan failure 17f67b54 PinnableSlice move assignment 6fb56c58 Blob DB: Add compaction filter to remove expired blob index entries f90ced92 Blob DB: fix snapshot handling 632f36dc Blob DB: option to enable garbage collection 11bacd57 Blob DB: Fix flaky BlobDBTest::GCExpiredKeyWhileOverwriting test f98efcb1 Blob DB: Evict oldest blob file when close to blob db size limit c1e99edd Blob DB: cleanup unused options ffc3c62c Blob DB: Initialize all fields in Blob Header, Footer and Record structs 9e825409 Blob DB: update blob file format d66bb21e Blob DB: Inline small values in base DB 05d5c575 Return write error on reaching blob dir size limit 2b8893b9 Blob DB: Store blob index as kTypeBlobIndex in base db 419b93c5 Blob DB: not writing sequence number as blob record footer 8afb0036 fix lite build dded348d Blob DB: Move BlobFile definition to a separate file 37473612 add GetLiveFiles and GetLiveFilesMetaData for BlobDB 8cff6e94 Enable WAL for blob index c2934729 Add ValueType::kTypeBlobIndex eae53de3 Make it explicit blob db doesn't support CF 65aec19d Fix memory leak on blob db open 30b38c98 TableProperty::oldest_key_time defaults to 0 2879f4be Bump version to 5.8.1 88595c88 Add DB::Properties::kEstimateOldestKeyTime 266ac245 Bumping version to 5.8 64185c23 update HISTORY.md for DeleteRange bug fix e83d6a02 Not using aligned_alloc with gcc4 + asan 0980dc6c Fix wrong smallest key of delete range tombstones b7679723 avoid use-after-move error c4174427 CMake: Fix formatting c21ea8f7 CMake: Add support for CMake packages 54443455 add Erlang to the list of language bindings 2972a702 Minor updates to FlushWAL blog fbfa3e7a WriteAtPrepare: Efficient read from snapshot list b01f426f Blog post for FlushWAL 503db684 make blob file close synchronous 3c840d1a Allow DB reopen with reduced options.num_levels 92bfd6c5 Fix DropColumnFamily data race 7fdf735d Pinnableslice examples and blog post 7fbb9ecc support disabling checksum in block-based table 19cc66dc fix clang bug in block-based table reader 7eba54eb test compaction input-level split range tombstone assumption cd26af34 Add unit test for WritePrepared skeleton a1247981 Improved transactions support in C API c10b3913 LANGUAGE-BINDINGS.md: add another rust binding 90177432 Remove leftover references to phutil_module_cache 234f33a3 allow nullptr Slice only as sentinel ccf7f833 Use PinnableSlice in Transactions 1dfcdb15 Extend pin_l0 to filter partitions 39ef9005 stop calling memcmp with nullptrs 78cb6b61 Provide byte[] version of SstFileWriter.merge to reduce GC Stall 867fe92e Scale histogram bucket size by constant factor f004307e CMake improvements 09ac6206 Circumvent ASAN false positive 5b68b114 Blob db create a snapshot before every read 4624ae52 GC the oldest file when out of space 8ace1f79 add counter for deletion dropping optimization 0d8e992b Revert the mistake in version update 5358a805 add VerifyChecksum to HISTORY.md ed0a4c93 perf_context measure user bytes read 1efc600d Preload l0 index partitions bddd5d36 Added mechanism to track deadlock chain c1384a70 fix db_stress uint64_t to int32 cast 29877ec7 Fix blob db crash during calculating write amp 8f2598ac Enable Cassandra merge operator to be called with a single merge operand 9a44b4c3 Allow merge operator to be called even with a single operand ac8fb77a fix some misspellings 23593171 minor improvements to db_stress af012c0f fix deleterange with memtable prefix bloom 1c8dbe2a update scores after picking universal compaction eb642530 Update WritePrepared with the pseudo code 132306fb Remove PartialMerge implementation from Cassandra merge operator 71598cdc Fix false removal of tombstone issue in FIFO and kCompactionStyleNone 3204a4f6 Fix missing stdlib include required for abort() 7aa96db7 db_stress rolling active window dfa6c23c Update RocksDBCommonHelper to use escapeshellarg e367774d Overload new[] to properly align LRUCacheShard ad42d2fc Remove residual arcanist_util directory 279296f4 properly set C[XX]FLAGS during CMake configure-time checks c5f0c6cc compile with correct flags to determine SSE4.2 support 185ade4c cmake: support more compression type 5449c099 rocksdb: make buildable on aarch64 a144a978 Fix for CMakeLists.txt on Windows for RocksJava acf935e4 fix deletion dropping in intra-L0 8254e9b5 make sst_dump compression size command consistent 74f18c13 db_bench support for non-uniform column family ops 5de98f2d approximate histogram stats to save cpu 3f588843 Fix c_test ASAN failure e5a1b727 Fix blob DB transaction usage while GC 6f051e0c fix corruption_test valgrind ac098a46 expose set_skip_stats_update_on_db_open to C bindings 666a005f Support prefetch last 512KB with direct I/O in block based file reader ad77ee0e Revert "Makefile: correct faligned-new test" b87ee6f7 Use more keys per lock in daily TSAN crash test 25df2425 Add column families related functions (C API) 64f84843 block_cache_tier: fix gcc-7 warnings 0cecf815 Write batch for `TransactionDB` in C API 6a9de434 Windows.h macro call fix 23c7d135 fix comment 1fbad84b Makefile: correct faligned-new test 7848f0b2 add VerifyChecksum() to db.h 47ed3bfc fix WinEnv assertions d97a72d6 Try to repair db with wal_dir option, avoid leak some WAL files 36375de7 gcc-7/i386: markup intentional fallthroughs bdc056f8 Refactor PessimisticTransaction a9a4e89c Fix valgrind complaint about initialization 4ca11b4b Update USERS.md c9804e00 Refactor TransactionDBImpl 20dc5e74 Optimize range-delete aggregator call in merge helper. 0d4a2b73 Avoid blob db call Sync() while writing 627c9f1a Don't add -ljemalloc when DISABLE_JEMALLOC is set dce6d5a8 db_bench background work thread pool size arguments 4f81ab38 Makefile: fix for GCC 7+ and clang 4+ 92afe830 Update all blob db TTL and timestamps to uint64_t 5883a1ae Fix /bin/bash shebangs cc01985d Introduce bottom-pri thread pool for large universal compactions 0b814ba9 Allow concurrent writes to blob db 2c45ada4 Blob DB garbage collection should keep keys with newer version 58410aee Fix the overflow bug in AwaitState c3d5c4d3 Refactor TransactionImpl 060ccd4f support multiple CFs with OPTIONS file 34538706 Fix statistics in RocksJava sample 1900771b Dump Blob DB options to info log 3218edc5 Fix universal compaction bug 6a36b3a7 fix db get/write stats a84cee81 Add a missing "once" in .h 21696ba5 Replace dynamic_cast<> e85f2c64 Prevent empty memtables from using a lot of memory ac748c57 Fix FIFO Compaction with TTL tests aaf42fe7 Move blob_db/ttl_extractor.h into blob_db/blob_db.h aace4651 Fix license headers in Cassandra related files 50a96913 CacheActivityLogger, component to log cache activity into a file 6083bc79 Blob DB TTL extractor 710411ae fix asan/valgrind for TableCache cleanup 3a3fb00b TARGETS file not setting sse explicitly fca4d6da Build fewer tests in Travis platform_dependent tests 8f553d3c remove unnecessary internal_comparator param in newIterator 7f6d012d "ccache -C" in Travis d12691b8 move TableCache::EraseHandle outside of db mutex f33f1136 fix db_bench argument type e7697b8c Fix LITE unit tests 3ce20e98 Fix use of RocksDBCommonHelper in cont_integration.sh c281b448 Revert "CRC32 Power Optimization Changes" 9980de26 Fix FIFO compaction picker test 2289d381 CRC32 Power Optimization Changes 30b58cf7 Remove the orphan assert on !need_log_sync fe1a5559 Fix flaky write_callback_test addbd279 5.6.1 release blog post 30edff30 buckification: remove explicit `-msse*` compiler flags 2b259c9d Lower num of iterations in DeadlockCycle test 277f6f23 Release note for partitioned index/filters 5e731a13 Remove unused rocksdb arcanist lib 9b11d434 Fix broken links 06f19174 add vcpkg as an windows option ea8ad4f6 Fix compaction div by zero logging 34112aef Added db paths to c 1d8aa296 Gcc 7 ParsedInternalKey replace memset with clear function. a4c42e80 Fix UBSAN issue of passing nullptr to memcmp 16e03882 LRUCacheShard cache line size alignment 216644c6 enable UBSAN macro in TARGETS e67b35c0 Add Iterator::Refresh() a34b2e38 Fix caching of compaction picker's next index 72502cf2 Revert "comment out unused parameters" 1d7048c5 comment out unused parameters 534c255c Cassandra compaction filter for purge expired columns and rows 63163a8c Remove make_new_version.sh 0302da47 Reduce blob db noisy logging 3e5ea29a Fix Flaky DeleteSchedulerTest::ImmediateDeleteOn25PercDBSize a22b9cc6 overlapping endpoint fixes in level compaction picker ffd2a2ee delete ExpandInputsToCleanCut failure log 3e6e863b Remove arcanist_util directory 36651d14 Moving static AdaptationContext to outside function 6e3ee015 Update java/rocksjni.pom ecff9d5e Include write_buffer_manager in ImmutableDBOptions::Dump ae28634e Remove some left-over BSD headers 33b1de82 Remove format compatibility hack 2f375154 checkout local branch in check_format_compatible.sh ddb22ac5 avoid collision with master branch in check format 0c03a7f1 set the remote for git checkout 7ac184c6 Revert cmake -DNDEBUG for non-MSVC 0655b585 enable PinnableSlice for RowCache 00464a31 Fix column_family_test with LITE build b2dd192f tools/write_stress.cc: Correct "1204" typos. cbaab304 table/block.h: change memset f1a056e0 CodeMod: Prefer ADD_FAILURE() over EXPECT_TRUE(false), et cetera 4a2e4891 Add back the LevelDB license file a7321fc9 Remove the licensing description in CONTRIBUTING.md 3c327ac2 Change RocksDB License 13201336 Make TARGETS file portable ccf5f08f Set CACHE_LINE_SIZE for s390, PPC, ARM64 67510eef db_crashtest.py: remove need for shell 4267eb00 Remove punit tests 5bfb67d9 Enable write rate limit for updaterandom benchmark 20a691d9 Update HISTORY to release 5.7 98d1a551 db_bench to by default verify checksum 26ce69b1 Update blob db to use ROCKS_LOG_* macro 43e4eef7 remove unnecessary fadvise 21b17d76 Fix BlobDB::Get which only get out the value offset 70440f7a Add virtual func IsDeleteRangeSupported 7550255c Add JAVAC_ARGS as Makefile variable 7a0b5de7 Gcc 7 ignored quantifiers 000bf0af Improve the design and native object management of Stats in RocksJava 269d383d Bump version to 5.7 c32f2722 Fixes db_bench with blob db fcd99d27 db_bench_tool: fix buffer size 87128bd5 fix regression test 8f927e5f Fix undefined behavior in Hash 643b787c Added a note about LZ4 compression dependency 56656e12 Temporarily disable FIFOCompactionWithTTLTest b5fb85ec fix valgrind init complaint 657df29e Add max_background_jobs to db_bench a43c053a remove duplicated utilities/merge_operators/cassandra/test_utils.cc in src.mk 7c4a9e6c Initialize a variable in ldb to make code analysis tool happy 98669b53 init filters_in_partition_ 0013bf14 fix asan and valgrind leak report in test 521b4c28 rocksdb 5.5.1 release post 33042573 Fix GetCurrentTime() initialization for valgrind f6b9d935 Fix clang error in PartitionedFilterBlockBuilder 45b9bb03 Cut filter partition based on metadata_block_size f4ae1bab update history for OnBackgroundError and DeleteRange fix 1cb8c6de Add -enable_pipelined_write to db_bench and add two defaults 7604b463 Update the AddDBStats in LITE 1e34d07e Simplify and document sync rules for logs_ etc d310e0f3 Regression test for empty dedicated range deletion file e9f91a51 Add a fetch_add variation to AddDBStats c1b375e9 skip generating empty sst 67b417d6 fix format compatible test afbef651 Bug fix: Fast CRC Support printing is not honest 397ab111 Improve Status message for block checksum mismatches 18c63af6 Make "make analyze" happy 01534db2 Fix the reported asan issues 1cd45cd1 FIFO Compaction with TTL 982cec22 Fix TARGETS file tests list b49b3710 allow numa >= 2.0.8 e517bfa2 CLANG Tidy dc3d2e4d update compatible test 89468c01 Fix Windows build broken by 5c97a7c0664d4071768113814e9ba71fe87e18cf 51778612 Encryption at rest support 7061912c Trivial typo in HISTORY.md 2a9cd879 Fix jni WriteBatchThreadedTest 0025a364 revert perf_context and io_stats to __thread 5c97a7c0 Unit Tests for sync, range sync and file close failures 4cee11f4 Intra-L0 blog post 857e9960 Improve the error message for I/O related errors. d757355c Fix bug that flush doesn't respond to fsync result 8e6345d2 Update rename of ParanoidCheck 499ebb3a Optimize for serial commits in 2PC 0ac4afb9 Sanitize partitioning options 521724ba fixed wrong type for "allow_compaction" parameter 71f5bcb7 Introduce OnBackgroundError callback 88cd2d96 Downgrade option sanitiy check level for prefix_extractor 6837a176 Fix Data Race Between CreateColumnFamily() and GetAggregatedIntProperty() af174675 WriteBufferManager will not trigger flush if much data is already being flushed 9467eb61 Fix flush assertion with tsan 048446fc Fix cassandra ASAN use-after-free a21db161 Implement ReopenWritibaleFile on Windows and other fixes c430d69e fix coredump for release nullptr 0d278456 default implementation for InRange cbd825de Create a MergeOperator for Cassandra Row Value 2c98b06b Remove pin_slice option by making it the default c80c6115 add db_bench options for partitioning 6a3377f4 Synchronize statistic enumeration values between statistics.h and java API 53dda879 Do not run RateLimiterTest.Rate test on Travis+Mac OSX. ae8571f5 Fix blob db compression bug 7a380def Update blob_db_test 89ad9f3a Allow ignoring unknown options when loading options from a file 6b5a5dc5 fixed typo 0f228be3 fixed typo in util/dynamic_bloom.h c217e0b9 Call RateLimiter for compaction reads 91e2aa3c write exact sequence number for each put in write batch 6f4154d6 record index partition properties 5d5a28a9 Fix Clang release build broken by 5582123dee8426a5191dfd5e846cea8c676c793c 0175d58c Make direct I/O write use incremental buffer 7a270069 GNU C library for struct tm has 2 additional fields. d713471d Limit trash directory to be 25% of total DB 9bb91e93 Dedup release 27b45016 Update HistogramTypes in the Java API e97304c6 update history for 5.6 5582123d Sample number of reads per SST file db818d2d Fix RocksDB Lite build with CLANG a472c4ae update 5.5 change log bc09c8a0 Fix crash in PosixWritableFile::Close() when fstat() fails 6d0f22e4 Fix mock_env.cc uninitialized variable c2012d48 Java APIs for put, merge and delete in file ingestion 85dace2a Disable DBRangeDelTest::TailingIteratorRangeTombstoneUnsupported for ubsan d4f7731b fix travis error with init time in mockenv 550a1df7 Fix clang errors by asserting the precondition cc5f9339 Fix concurrency issue with filter_block_set_ 2e64f450 bump version to 5.6 afbc2d0d Force travis to build with clang on MacOS b172a3f1 Fix warnings while generating RocksJava documentation 52a7f38b WriteOptions.low_pri which can throttle low pri writes if needed 26a8a807 Switch from CentOS 5 to CentOS 6 for crossbuilding RocksJava dba9f372 Fix db_write_test clang/windows build failure c7662a44 fixed typo 7e8d95cc Fix the Java build which was broken by a4d9c02 7e5fac2c remove test dir before exit when current regression is running 7f6c02dd using ThreadLocalPtr to hide ROCKSDB_SUPPORT_THREAD_LOCAL from public… 138b87ea Fix interaction between CompactionFilter::Decision::kRemoveAndSkipUnt… 95b0e89b Improve write buffer manager (and allow the size to be tracked in block cache) a4d9c025 Pass CF ID to MemTableRepFactory f68d88be Fix DBWriteTest::ReturnSequenceNumberMultiThreaded data race 215076ef Fix TSAN: avoid arena mode with range deletions 3a8a848a account for L0 size in estimated compaction bytes 0fae3f5d codemod: format TARGETS with buildifier [5/5] (D5092623) 87219960 add checkpoint support for single db in regression test 5a9b4d74 Retire memenv https://github.com/facebook/rocksdb/pull/2082 d6019651 sync internal/external TARGETS bbaba51b Add missing index type to C-API 292edfd5 travis: test with xcode8.3 (OS X 10.12) 0dc3040d db: avoid `#include`ing malloc and jemalloc simultaneously 9b3ed835 fix regression test 9c9909bf Support ingest file when range deletions exist ad19eb86 Fixing blob db sequence number handling 51ac91f5 Histogram of number of merge operands 345878a7 update blob_db_test cbc821c2 change regression rebuild to one level 103d0692 Avoid unsupported attributes when not building with UBSAN 5fd04566 travis: reduce the number of travis builders 2d05002b RocksDB 5.4.5 release blog post 7eca90f1 Update RocksDB blog authors d03c3449 update comment of GetNextFile f7bb1a00 support merge and delete in file ingestion c2c62ad4 Reorder variables of ReadOptions 7bb1f5d4 Increase of compaction threads should be logged at info level instead of a warning 6c456eca Clean zstd files 347e16f8 codemod: replace `headers = AutoHeaders.*` with `auto_headers` 0be636bf Fix db_bench build break with blob db 135ee6a3 fix tsan crash data race a99fb992 fix column_family_test asan f41bffb3 travis: clang-3.6 -> clang-4.0 e7612798 update buckifer/TARGETS bb01c188 Introduce max_background_jobs mutable option 5a253046 Fix the CMakeLists for RocksJava 41cbb727 options.delayed_write_rate use the rate of rate_limiter by default. 50680346 range sync should be enabled 02594b5f Fix build errors in blob_dump_tool with GCC 4.8 52d9e5f7 Fix column family seconds_up accounting 7d8207f1 Fix errors in clang-analyzer builds 85b8569a Fix release build on Linux 69ec8356 Allow SstFileWriter to use the rate limiter 6cc9aef1 New API for background work in single thread pool 9d0a07ed Fix rocksdb.estimate-num-keys DB property underflow 578fb0b1 Simple blob file dumper ac39d6be Core-local statistics 3e86c0f0 disable direct reads for log and manifest and add direct io to tests 15ba4d6c Address MS Visual Studio 2017 issue with autovector 88c818e4 Replace deprecated RocksDB#addFile with RocksDB#ingestExternalFile 228f49d2 Fix data races caught by tsan 4c9d2b10 remove #include port/port.h in public header file 07bdcb91 New WriteImpl to pipeline WAL/memtable write d746aead Suppress clang-analyzer false positive 217b866f column_family_test: EnvCounter::num_new_writable_file_ to be atomic 9f839a7f keep util/build_version.cc when make clean 7eecd40a add emacs tags file - etags 9bbba4fe Remoe unused BlockBasedTable::compaction_optimized_ f5ba131b Fixed some spelling mistakes 146b7718 Fix mingw compilation with -DNDEBUG a36220cc fix unity test 0ebdd705 fixed typo 8032f4cb Remove -pie in TSAN 362ba9b0 Release RocksDB 5.5.0 ba685a47 Support ingest_behind for IngestExternalFile 01ab7b52 Add ROCKSDB_LIBRARY_API macro to a few C APIs, to fix windows build cb9392a0 add Transactions and Checkpoint to C API 445f1235 s/std::snprintf/snprintf cd593c28 Fix travis java_test f720796e fixed typo a48a62d5 define NDEBUG in CMake non-debug builds 1ca723db C API: support pinnable get 2ef15b85 Core-local stats blog post 4f9e69cc fix log err 11c5d474 cross-platform compatibility improvements d0043330 Put lib files into suitable path in RPM package 86d54925 Fix build error with blob DB. 254c4680 Fix the RocksJava Release on Windows 7a47b431 Fix .gitignore pattern fa5a15ce Make sure that zstd is statically linked correctly in the Java static build 3fa9a39c Add GetAllKeyVersions API 1a60982a Simplified instructions for CentOS a5cc7ece Facility for cross-building RocksJava using Docker ccd3dddf Blog post for partitioned index/filters b145c34d Update blog authors bbe9ee7d core-local array type conversions c2be4343 Build and link with ZStd when creating the static RocksJava build c61e72c4 Add missing files of blob_db to CMake file 3907c94f Fix ColumnFamilyTest:BulkAddDrop cda5fde2 CoreLocalArray class 93949667 update TARGETS 4e83b800 title: Bulkoading -> title: Bulkloading d85ff495 Blob storage pr 492fc49a fix readampbitmap tests be421b0b portable sched_getcpu calls 0f559abd Add NO_UPDATE_BUILD_VERSION option to makefile 3a04a254 Flink state 35df23fe Fix suite exclisions e7cea86f Fixes the CentOS 5 cross-building of RocksJava 259a00ea unbiase readamp bitmap a6209669 port: updated PhysicalCoreID() df035b68 Print compaction_options_universal.stop_style in LOG file 4897eb25 dont skip IO for filter blocks 3f73d54b Add C API to set max_file_opening_threads option 0b69e507 Define CACHE_LINE_SIZE only when it's not defined 2cd00773 Add bulk create/drop column family API 40af2381 Object lifetime in cache fdaefa03 travis: add Windows cross-compilation a30a6960 do not read next datablock if upperbound is reached 2d42cf5e Roundup read bytes in ReadaheadRandomAccessFile 264d3f54 Allow IntraL0 compaction in FIFO Compaction 8c3a180e Set lower-bound on dynamic level sizes 7c1c8ce5 Avoid calling fallocate with UINT64_MAX a45e98a5 max_open_files dynamic set, follow up 6b99dbe0 fix memory alignment with logical sector size e7ae4a3a Max open files mutable 60847a3b port: updated PhysicalCoreID() b551104e support PopSavePoint for WriteBatch 498693cf Remove orphaned Java classes 5e2ebf2b travis: add CMake compilation af6fe69e Fix an issue of manual / auto compaction data race 6798d1f3 Revert "Delete filter before closing the table" 89833577 Delete filter before closing the table 47a09b0a Avoid pinning when row cache is accessed aeaba07b Remove an assert that causes TSAN failure. 0b90aa95 Set VALGRIND_VER a2b05210 Make PosixLogger::flush_pending_ atomic da4b2070 Fix WriteBatchWithIndex address use after scope error d616ebea Add GPLv2 as an alternative license. 4439b459 Add documentation license 0ca3ead0 add GetRootDB() in DeleteFilesInRange cdad04b0 Remove double buffering on RandomRead on Windows. e15382c0 Disable two flaky tests 2150cc1f fix WritableFile buffer size in direct IO efc361ef Add user stats Reset API 6616e4d6 add prefetch to PosixRandomAccessFile in buffered io f6a27d0b Extract statistics tests into separate file 7eddecce support bulk loading with universal compaction 3b4d1b7a add <sys/sysmacros.h> to avoid warning with glibc 2.25 e5e545a0 Reunite checkpoint and backup core logic 72c21fb3 call GetRootDB() before cast to DBImpl* in CancelAllBackgroundWork 4c9447d8 Add erase option to release cache 04d58970 AIX and Solaris Sparc Support afff9951 Respect deprecated flag in table options 066cfbac Adding -noprofile to CMakeLists for Windows cb885bcc set compaction_iterator earliest_snapshot to max if no snapshot 7534ba7b StackableDB should pass ResetStats() c1fbf91b Fixing Solaris Sparc crash due to cached TLS 963eeba4 Revert how check_format_compatible.sh checkout release branches. 97005dbd tools/check_format_compatible.sh to cover option file loading too 8f619678 Add cpu usage to regression benchmarks (4th attempt) df74b775 Limit backups opened 1dd77605 Change L0 compaction score using level size 927bbab2 Revert "Add cpu usage to regression benchmarks (3rd attempt)" 8e84a388 Re-add index_per_partition but as deprecated 1553659d Add more recent versions to tools/check_format_compatible.sh 966ebb02 Hide event listeners from lite build 476e80be Add cpu usage to regression benchmarks (3rd attempt) c49d7046 Add DB:ResetStats() 0fcdccc3 Blob storage helper methods a6439d79 CMake: compile with -O2 e67f0adf enable O2 optimization for lz4 bc397325 CMake: add support for SSE4.2 7d5f5aa9 Separate compile and link for shared library 07165273 remove warning 6e8d6f42 readahead backwards from sst end ca96654d Change Build Env to gcc-5 e9e6e532 Simplify write thread logic 6799c7e0 Pass in remote as a param to branch creation script 44fa8ece change use_direct_writes to use_direct_io_for_flush_and_compaction 13b50358 add space for buggy kernel warning b6b9359e Fix BYTES_WRITTEN accounting 13369fbd Update ShipIt to honor TARGETS updates f2449ce9 Remove .deprecated_arcconfig 415be221 RocksDB Release 5.4 : Update HISTORY.md and build version. 3eab41d7 java dependencies test -s -> use test -d a22ed4ea internal_repo_rocksdb to build Java and RocksDB LITE 9f2cc59e sync TARGETS file 10d75469 set readahead buffer size from roundup(user_size) + 4k to roundup(use… ba7da434 fix db_stress crash caused by buggy kernel warning 6257837d Add ROCKSDB_JAVA_NO_COMPRESSION flag 6a6723ee Move MergeOperatorPinning tests to be with other merge operator tests 6a8d5c01 Revert "Report cpu usage using time command" 8f47a975 File level histogram should be printed per CF, not per DB 9300ef54 Fix shared lock upgrades 1f8b119e Limit maximum memory used in the WriteBatch representation 97ec8a13 Report cpu usage using time command 20778f2f Adding comments to the write path 7124268a Reduce the number of params needed to construct DBIter 04abb2b2 FreeBSD only requires WITH_JEMALLOC, not the rest 61730186 dummy diff 360e9960 Summary: Remove .arcconfig 69a5e646 Deprecate .arcconfig 9690653d Add a verify phase to benchmarks dd8f9e38 Fix compilation for GCC-5 c2954f9b Add Travis job to build examples 72fc1e9d avoid non-existent O_DIRECT on OpenBSD ff972870 Refactor compaction picker code 9e729390 only FALLOC_FL_PUNCH_HOLE when ftruncate is buggy 343b59d6 Move various string utility functions into string_util 1d068f60 Fix CompactRange incorrect buffer release df6f5a37 Move memtable related files into memtable directory 107c5f6a CMake: more MinGW fixes d2dce561 Move some files under util/ to separate dirs c50e3750 Use a human readable size for level report ce64b8b7 Divide db/db_impl.cc 02799ad7 Revert "delete fallocate with punch_hole" e2a7b202 Release note for partition filters af256eb2 build db every monday e5a1372b Rework test running script. d659faad Level-based L0->L0 compaction a12306fa Add a notice on gflags installation in INSTALL.md 43010a92 Revert "[rocksdb][PR] CMake: more MinGW fixes" a30b75cd Add buckifier script to github repo 3450ac8c CMake: more MinGW fixes 90cfd464 update IterKey that can get user key and internal key explicitly e2c6c063 add TimedEnv 9e445318 Refactor WriteImpl (pipeline write part 1) 6ef8c620 Move auto_roll_logger and filename out of db/ a1c469d7 Add release notes for PinnableSlice 0537f515 fix run_remote with strong quoting 72e60009 fixed misses on Centos library installation instructions 88cc81df auto_roll_logger_test to move away from real sleep d25e28d5 replace sometimes-undefined uint type with unsigned int a1d7e487 Add L0 write-amp to compaction level stats b6d60906 CMake: support AVX2 in MinGW bd7d1383 test remote instead run remote in regression test c81a805f test db existence on the remote host 5fc1e676 add -rf when remove db in regression test 4ab4049f gflags has moved to GitHub 4e006501 make all DB::Get overloads virtual 6401a8b7 Fix build with MinGW 80fe5b38 disable test: DeleteSchedulerTest.DynamicRateLimiting1 a9c86f51 backup garbage collect shared_checksum tmp files da175f7e exit with code 2 when there is already a db_bench running in regression test 0ee7f040 Added missing options to RocksJava c6d04f2e Option to fail a request as incomplete when skipping too many internal keys 58179ec4 Cleanup of ThreadStatusUtil structures should use the DB's reference f3607640 add ldb build to regression test 8a8c9674 Enable Fast CRC32 for Win64 f9813b85 Added SstFileWriter construtor without explicit comparator to JNI api 8d3cb4f2 Added naming of backup engine threads 67d76237 Expose the stalling information through DB::GetProperty() 0fd57492 delete fallocate with punch_hole 41fe9ad7 Hide usage of compaction_options_fifo from lite build e7731d11 Configure index partition size 69c8d524 Fix jni library name for PowerPC Architecture 34a70859 Fix segmentation fault caused by #1961 8dee8cad Enable fifo compaction benchmark to db_bench a5c8b543 fix a header include 91b5feb3 Fix Windows Build broken by a recent commit 41ccae6d Add C API functions (and tests) for WriteBatchWithIndex 88bb6f6b non_shm CI should run tests on /tmp 8888de2b Update .gitignore file in examples 203136e7 Fix Compilation errors when using IBM Java f4fce475 Fix clang compile error - [-Werror,-Wunused-lambda-capture] a084b26a Blog post for releasing 5.2.1 15950fe3 Remove ASSERT_EQ(boolean, ...) 3e56c7e0 make total_log_size_ atomic 909028e2 HISTORY.md for log_size_for_flush in CreateCheckpoint() be723a8d Optionally construct Post Processing Info map in MemTableInserter e474df94 db_bench: not need to check mmap for PlainTable 8b0097b4 Readers for partition filter 9ef3627f Allow checkpointing without flushing 17866ecc Allow Users to change customized ldb tools' header in help printing a2a88331 remove deleted option from benchmark.sh 78cb1955 add checkpoint to ldb 4b04addf updated solution if "make format" command fails 8f5bf044 Flush triggered by DB write buffer size picks the oldest unflushed CF 6908e24b dynamic setting of stats_dump_period_sec through SetDBOption() 93c68b64 change regression bash file with debug mode 21d8c317 remove LIKELY from public headers 36ad7577 INSTALL: document USE_SSE 9272e12f avoid ftruncate twice in buffered io d52f334c Break stalls when no bg work is happening e66221ad fix db_bench rate limiter callsites dbae438a Replace "DEPRECATED" comment to "not supported" 995618a8 Support SstFileManager::SetDeleteRateBytesPerSecond() e1916368 Add macros to include file name and line number during Logging d525718a cleanup direct io flag in WritableFileWriter 5fa927aa Add Xpress and ZSTD CompressionType values to C header 11526252 Pinnableslice (2nd attempt) e5bd8def update history.md for fixing the bug that skips keys 1ffbdfd9 Add a new SstFileWriter constructor without explicit comparator ebd5639b Add ability to search for key prefix in sst_dump tool e6725e8c Fix some bugs in MockEnv 900c62be fix compile for VS2015 fe183561 release 5.3 5dae0194 Revert "Report cpu usage using time command" f2817fb7 avoid ASSERT_EQ(false, ...); 5b11124e add max to histogram stats d43adf21 Report cpu usage using time command 18fc1bc0 minor changes for rate limiter test flakiness 12ba00ea Reset DBIter::saved_key_ with proper user key anywhere before pass to DBIter::FindNextUserEntry c9df05d1 Fix random access alignment f6499153 Add Bulkoading IngestExternalFile blog post 54b43411 Builders for partition filter 97edc72d Add a memtable-only iterator 72202962 fix db_sst_test flakiness 5f65dc87 Expose DB::DeleteRange and WriteBath::DeleteRange in Java 58b12dfe Set logs as getting flushed before releasing lock, race condition fix f8a4ea02 Move db_test and external_sst_file_test out of Travis's MAC OS run 534581a3 Fix a bug in tests in options operator= a2f7a514 Refactoring 2a5daa06 Add stderr log level for ldb backup commands 4561275c fix rate limiter test flakiness 7c80a6d7 Statistic for how often rate limiter is drained 0ad5af42 Clarify VerifyBackup behavior 6fb90134 sanitize readahead when direct read enabled f89b3893 Remove skip_table_builder_flush and default it to true cc253982 Use more default options in db_bench 8432bcf5 Make compaction_pri settable through option string d5b607a4 Make db_wal_test slightly faster ba4c77bd Divide external_sst_file_test e877afa0 Remove bulk loading and auto_roll_logger in rocksdb_lite 90d83550 Fix the wrong address for PREFETCH in DynamicBloom::Prefetch 08864df2 Move advanced column family options to advanced_options.h 2ca2059f Get unique_ptr to use delete[] for char[] in DumpMallocStats 253799c0 Add missing include for `abort()` c6d464a9 Fixed various memory leaks and Java 8 JNI Compatibility be3e5568 Fix unaligned reads in read cache 8ad0fcdf Separate small subset tests in DBTest 6c951c43 Run fewer tests in OSX f7997f13 add direct I/O to version notes 5.2.0 3b8ba703 Fix flaky DBTestUniversalCompaction.UniversalCompactionTrivialMoveTest2 96c7e150 Fix Java build e0b87afc Black list some slow valgrind tests e67232cf Handle failed Finish() in SST file writer 8efb5ffa [rocksdb][PR] Remove option min_partial_merge_operands and verify_checksums_in_comp… 1ba2804b Remove XFunc tests e7d902e6 add direct_io and compaction_readahead_size in db_stress 1ef5f50e detect logical sector size ed50308d check backup directory exists before listing children 4d7c06ce Make WriteBatchWithIndex moveble 5040414e Gracefully handle previous backup interrupted f206af56 add use_direct_io() to ReadaheadRandomAccessFile 08249344 truncate patch 286a36db posix writablefile truncate f0879e4c Page size isn't always 4k on linux 18eeb7b9 Fix interference between max_total_wal_size and db_write_buffer_size checks 1560b2f5 Temporarly return deprecated functions to fix MongoRocks build 2a0f3d0d level compaction expansion ebc8a799 alignment is on in ReadaheadRandomAccessFile::Read() 381fd322 Remove timeout_hint_us from WriteOptions fce7a6e1 Fail IngestExternalFile when bg_error_ exists a618a16f New subcode for IOError to detect the ESTALE errno 7ab00518 Remove deprecated DB::AddFile and DB::CompactRange 40166736 Adding Dlang to the list 756c5924 Allow adding external v1 sst file with no global seqno support aa0298fa Remove trailing whitespace from examples Makefile db2b4eb5 avoid direct io in rocksdb_lite 43e9f01c Fix repair_test on ROCKSDB_LITE 7106a994 Use monotonic time points in write_controller.cc and rate_limiter.cc c2247dc1 Make DBImpl::has_unpersisted_data_ atomic eb912a92 Remove disableDataSync option 0227c16d Update static library versions and add checksums b3aae4d0 Add repair_test to make check 421ce7c2 Add support for JNI Library on Linux on PowerPC. 9afa20cf Increase build version and HISTORY.md for releasing 5.2 a5adda06 Fix repair issues b48e4778 Consolidate file cutting logic in compaction loop ac2a77a7 Announce the experimetnal two-level index feature in HISTORY.md c4a37dcb Print the missed last layer in cfstats a12818af Blog post for 5.1.2 release 3b4ac807 Clarify ldb column family argument d70ce7ee Move db_bench flags out of unnamed namespace 186c7eed Remove incorrect statistics warning 53bb0151 [rocksdb][PR] compaction_style and compaction_pri should output their value as a st… 69d5262c Two-level Indexes 0a4cdde5 Windows thread 1aaa898c Adding GetApproximateMemTableStats method 9fc23c55 Use gcc-4.9-glibc-2.20-fb python in precommit_checker b797e421 Dump compression dictionary meta-block 036d668b Fix wrong result in data race case related to Get() 574b543f Rename merger.h -> merging_iterator.h add8b50c Move ThreadLocal implementation into .cc 71d2496a Fix arc setting for Facebook internal tools f289d9f4 Fix OSX build break after the fallocate change 4a3e7d32 Change the default of delayed slowdown value to 16MB/s 0513e21f RangeSync() should work with ROCKSDB_FALLOCATE_PRESENT not set 8b369ae5 Cleaner default options using C++11 in-class init ec79a7b5 Dedup code in option.cc and db_options.cc b96372de improving the C wrapper 04c4ec41 Change corruption_test to use 4 bits. 2d75cd40 NewLRUCache() to pick number of shard bits based on capacity if not given f25f1ec6 Add test DBTest2.GetRaceFlush which can expose a data race bug 37d4a79e Deserialize custom Statistics object in db_bench 3b35134e Avoid cache lookups for range deletion meta-block 94a0c32e Fix LRU Ref() for handles with external references only 17c11806 Generalize Env registration framework 07dddd5f EnvPosixTestWithParam should wait for all threads to finish 5dad9d6d Avoid logs_ operation out of DB mutex a7b13919 Fix CompactFiles() bug when used with CompactionFilter using SuperVersion 616a1464 Fix DeleteRange including sentinels in output files c918c4b7 Update USERS.md add user Pika 03ca2ac8 Remove function from DBImpl that are not used anywhere b0029bc7 Test merge op covered by range deletion in memtable d438e1ec Test range deletion block outlives table reader fba726e5 Version librocksdb.so 9da4d542 Range deletions unsupported in tailing iterator f2b4939d fixed typo 973f1b78 memtable: delete merge value for range deleteion aebfd170 fix non-portable behavior in encoder 753ff84a Fix get approx size d7ea44f2 Fixup a couple of builds errors on Linux. 537da370 c: allow set savepoint to writebatch af6ec4d7 fix batchresult handle leak e29bb934 Zlib 1.2.8 is no longer available, switched to 1.2.10 5ac97314 Fix std::out_of_range when DBOptions::keep_log_file_num is zero 4e35ffdf cmake: check -momit-leaf-frame-pointer before using it 3c0852d1 Make ingest external file backward compatible 0e8dfd60 Fix OptimizeForPointLookup() e840213d Change DB::GetApproximateSizes for more flexibility needed for MyRocks 9239103c Flush job should release reference current version if sync log failed da54d36a Disable IngestExternalFile in ReadOnly mode 5cf176ca Fix for 2PC causing WAL to grow too large 4a73bb0b Split travis jobs c70d3c7a Enable DBTest.GroupCommit as it runs in a reasonlable time now. 602c13a9 Remove fadvise with direct IO read f9d18e22 Fix DeleteRange file boundary correctness issue with max_compaction_bytes 3ce091fd Add KEEP_DB env var option 77b48066 Fix 2PC with concurrent memtable insert e8a09600 util/thread_local.h: silence a clang-build warning 324a0f98 Follow up for DirectIO refactor bc5d7b70 travis: For linux, do all tests under gcc 3e6899d1 change UseDirectIO() to use_direct_io() d4e07a84 fix warning of unused direct io helper functions dc2584ee direct reads refactor d18dd2c4 Abort compactions more reliably when closing DB 62384ebe Guarding extra fallocate call with TRAVIS because its not working pro… 9f246298 Performance: Iterate vector by reference fe395fb6 Allow incrementing refcount on cache handles 2172b660 Fix build on FreeBSD 3c233ca4 Fix Windows environment issues 76317345 Fix the error in ColumnFamiliesTest 7a02ad07 Update travis to ubuntu trusty 60c509ff Fix valgrind failure in test CurrentFileModifiedWhileCheckpointing2PC d0ba8ec8 Revert "PinnableSlice" 54d94e9c PinnableSlice e04480fa Fix MS warnings. Use ROCKSDB_Prsz for size_t. c081f721 5.0.1 release blog post ac73d755 Add GetSupportedCompressions() convenience function b104b878 Maintain position in range deletions map 640d7248 Update db_bench and sst_dump to test with block cache mid-point inser? 653ac1f9 C API: support total_order_mode 85ac1a32 Fix rocksdb::Status::getState 76711b6e Make ExternalSSTFileTest::CompactionDeadlock more deterministic c963460d Fix tests under GCC_481 33c86d67 Fix backupable db test e425ec11 utilities/backupable: backup should limit the copy size of wal. 0712d541 Delegate Cleanables d58ef52b Allow SstFileWriter to Fadvise the file away from page cache 17a4b75c Always fsync the file after file copying 2fb70dc7 examples: Add options_file_example to target all a738af8f db/pinned_iterators_manager.h: bugfix 906523d9 Add description to the 2PC checkpooint bug in HISTORY.md 438f22bc Fix bug of Checkpoint loses recent transactions with 2PC 335981d4 Fix the directory path for RocksDB repo 548b6280 Enable conditionally using adaptive mutexes 4e07b08e include/rocksdb/utilities/env_librados: fix typo ab48c165 Print cache options to info log 972f96b3 direct io write support 989e644e Remove sst_file_manager option from LITE 1beef656 Fix c_test 3d692822 persistent_cache: fix two timer 046099c9 The array is malloced by backtrace_symbols(), and must be freed 6ff2c8d7 Remove gflags as travis build dependency 3cd9ed1c Show sandcastle URL in phabricator 50e305de Collapse range deletions 5d1457db Dump persistent cache options 7bd725e9 db_bench: introduce --benchmark_read_rate_limit 29669184 Update Netflix section of USERS.md 342370f1 Simplify MemTable::Update 1a136c1f Expose file size fbff4628 Reduce compaction iterator status checks bd6cf7b5 WritableFileWriter: default buffer size equal min(64k,options.writabl? fc0c6fd9 "make format" format diff since last commit from master 816c1e30 gcc-7 requires include <functional> for std::function c2707358 Iterator should be in corrupted status if merge operator return false a8bf4d63 Make format shows wrong curl command for retrieving clang-format-diff.py 8f5d24ae C API: support get usage and pinned_usage for cache 0ab6fc16 Gcc-7 buffer size insufficient b7239bf7 Gcc 7 fallthrough 477b6ea5 std::remove_if requires <algorithm> 83f9a6fd Fail BackupEngine::Open upon meta-file read error a79eae4b Add pcache documentation images d71e728c Print user collected properties in sst_dump 7004a6f7 Add missing copyright header 3cdfaeca Fixes for MSVC compilation e097222e util/logging.cc: buffer of insufficient size (gcc-7 -Werror=format-length) cfc34d7c Missing break in case in DBTestBase::CurrentOptions bfbcec23 Gcc 7 error expansion to defined 6653e32a build: make it easier to pass PORTABLE 67adc937 intentional fallthough (prevents gcc-7/clang-4 error) 1a146f89 break Flush wait for dropped CF c3e5ee71 util/histogram.cc: HistogramStat::toString buffer insufficient 5334d8b4 table/block_based_table_builder.cc: intentional fallthrough - comment to match gcc pattern 36d42e65 Disable test to unblock travis build b57dd926 C API: support writebatch delete range 2ba59b5a Disallow ingesting files into dropped CFs 1f6f7e3e cast to signed char in ldb_cmd_test for ppc64le 243975d5 More accurate error status for BackupEngine::Open f0c509e2 Return finer-granularity status from Env::GetChildren* dc64f46b Add db_bench option for stderr logging 2cabdb8f Increase buffer size 4a17b47b Remove unnecessary header include 8c2b921f Fixed a crash in debug build in flush_job.cc 20ce081f Fix issue where IngestExternalFile insert blocks in block cache with g_seqno=0 5241e0db fix db_bench argument type c04f6a0b Specify shell in makefile 45c7ce13 CompactRangeOptions C API 2c2ba682 db_stress support for range deletions b821984d DeleteRange read path end-to-end tests 2f4fc539 Compaction::IsTrivialMove relaxing 1dce75b2 Update USERS.md 304b3c70 Update USERS.md fa50fffa Option to expand range tombstones in db_bench c26a4d8e Fix compile error in trasaction_lock_mgr.cc ed8fbdb5 Add EventListener::OnExternalFileIngested() event 2005c88a Implement non-exclusive locks 0b0f2357 Mention IngestExternalFile changes in HISTORY.md 23db48e8 Update HISTORY.md for 5.0 branch beb36d9c Fixed CompactionFilter::Decision::kRemoveAndSkipUntil 67f37cf1 Allow user to specify a CF for SST files generated by SstFileWriter 9053fe2a Made delete_obsolete_files_period_micros option dynamic edde954e fix clang build 56281f3a Add memtable_insert_with_hint_prefix_size option to db_bench 4a21b140 Cache heap::downheap() root comparison (optimize heap cmp call) e39d0808 Fix travis (compile for clang < 3.9) 3f407b06 Kill flashcache code in RocksDB b77007df Bug: paralle_group status updated in WriteThread::CompleteParallelWorker 247d0979 Support for range skips in compaction filter 96fcefbf c api: expose option for dynamic level size target 00197cff Add C API to set base_backgroud_compactions 5b219ecc deleterange end-to-end test improvements for lite/robustness aad11917 pass rocksdb oncall to mysql_mtr_filter otherwise tasks get created w… e3335289 DeleteRange write path end-to-end tests 7784980f Fix mis-reporting of compaction read bytes to the base level 3c6b49ed Fix implicit conversion between int64_t to int b3b87565 Remove unused assignment in db/db_iter.cc 4f6e89b1 Fix range deletion covering key in same SST file a2bf265a Avoid intentional overflow in GetL0ThresholdSpeedupCompaction 52fd1ff2 disable UBSAN for functions with intentional -ve shift / overflow 1886c435 Fix CompactionJob::Install division by zero 63c30de8 fix options_test ubsan 13e66a8f Fix compaction_job.cc division by zero 01eabf73 Fix double-counted deletion stat 7ffb10fc DeleteRange compaction statistics 236d4c67 Less linear search in DBIter::Seek() when keys are overwritten a lot cd7c4143 Improve Write Stalling System dfb6fe67 Unified InlineSkipList::Insert algorithm with hinting 3068870c Making persistent cache more resilient to filesystem failures 734e4aca Eliminate redundant cache lookup with range deletion 182b940e Add WriteOptions.no_slowdown 4118e133 Persistent Cache: Expose stats to user via public API f2a8f92a rocks_lua_compaction_filter: add unused attribute to a variable 4444256a Remove use of deprecated LZ4 function 548d7fb2 Fix fd leak when using direct IOs fd43ee09 Range deletion microoptimizations 23a18ca5 Reword support a little bit to more clear and concise 481856ac Update support to separate code issues with general questions a0deec96 Fix deadlock when calling getMergedHistogram fe349db5 Remove Arena in RangeDelAggregator e63350e7 Use more efficient hash map for deadlock detection a13bde39 Skip ldb test in Travis 73843aa6 Direct I/O Reads Handle the last sector correctly. 9d60151b Implement PositionedAppend for PosixWritableFile 3f622152 Lazily initialize RangeDelAggregator's map and pinning manager 41e77b83 cmake: s/STEQUAL/STREQUAL/ c1038d28 Release RocksDB 5.0 635a7bd1 refactor TableCache Get/NewIterator for single exit points f39452e8 Fix heap use after free ASAN/Valgrind a4eb7387 Allow plain table to store index on file with bloom filter disabled 36e4762c Remove Ticker::SEQUENCE_NUMBER 86eb2b9a Fix src.mk 0765babe Remove LATEST_BACKUP file 647eafdc Introduce Lua Extension: RocksLuaCompactionFilter 760ef68a fix deleterange asan issue 327085b7 fix valgrind 715591bb Ask travis to use JDK 7 972e3ff2 Enable allow_concurrent_memtable_write and enable_write_thread_adaptive_yield by default 420bdb42 option_change_migration_test: force full compaction when needed 1543d5d9 Report memory usage by memtable insert hints map. 018bb2eb DeleteRange support for db_bench dc51bd71 CMakeLists.txt: FreeBSD has jemalloc as default malloc 48e8baeb Decouple data iterator and range deletion iterator in TableCache 4b0aa3c4 Fix failed compaction_filter_example and add it into make all 53b693f5 ldb support for range delete 661e4c92 DeleteRange unsupported in non-block-based tables 489d1428 DeleteRange interface eba99c28 Fix min_write_buffer_number_to_merge = 0 bug 2ef92fea Remove all instances of relative_url until GitHub pages problem is fixed. 91300d01 Dynamic max_total_wal_size option ec2f6479 Consider subcompaction boundaries when updating file boundaries for range deletion 800e5155 Fix CSS issues again b952c898 Parallize persistent_cache_test and transaction_test 3b192f61 Handle full final subcompaction output file with range deletions 6c579520 Make range deletion inclusive-exclusive 425210cc CSS issues are arising on the Github Pages side. Temp fix. 1ea79a78 Optimize sequential insert into memtable - Part 1: Interface df5eeb85 Optimize sequential insert into memtable - Part 2: Implementation 5ed65085 Fix SstFileWriter destructor adb665e0 Allowed delayed_write_rate option to be dynamically set. 307a4e80 sst_dump support for range deletion 361010d4 Exporting compaction stats in the form of a map 672300f4 Use relative Urls for stylesheets b39b2ee1 do not call get() in recovery mode 1ca5f6d1 Fix 2PC Recovery SeqId Miscount e095d0cb Rocksdb contruns to new Sandcastle API 14c0380e Convenience option to parse an internal key on command line c90fef88 fix open failure with empty wal 4e20c5da Store internal keys in TombstoneMap a9fb346e Fix RocksDB Lite build failure in c_test.cc d133b08f Use correct sequence number when creating memtable 144cdb8f 16384 as e.g .value for compression_max_dict_bytes 9bd191d2 Fix deadlock between (WriterThread/Compaction/IngestExternalFile) a9fae0a9 CSS problems again :( 193221e0 Fix Forward Iterator Seek()/SeekToFirst() e48f3f8b remove tabs and duplicate #include in c api 85bd8f51 Minor fix to GFLAGS usage in persistent cache a7875272 c: support seek_for_prev 0f17f927 Make the header links a bit more flexible cf19f559 single quotes in feed 2dc019e0 Fix header links f1aedda0 More Jekyll 3.3 fixes c54cdc37 More Jekyll 3.3 updates 2bcaf824 Update product and feature template for Jekyll 3.3 24bceb09 Java API - Implement GetFromBatch and GetFromBatchAndDB in WBWI 815f54af Insert range deletion meta-block into block cache 9e7cf346 DeleteRange user iterator support 5c5d01ae Fix wrong comment (Maximum supported block size) f998c979 DeleteRange Get support 879f3663 Add C api for RateLimiter 557034f3 Remove all instances of baseurl 437942e4 Add avoid_flush_during_shutdown DB option 2b16d664 Change max_bytes_for_level_multiplier to double 16fb0443 expose IngestExternalFile to c abi ce22ea99 Fix casts for MSVC 196af035 Introduce FAIL_ON_WARNINGS CMake variable (default ON) 40a2e406 DeleteRange flush support d5555d95 Fix MSVC compile error in 32 bit compilation da61f348 Print compression and Fast CRC support info as Header level f9eb5679 db_bench: --dump_malloc_stats takes no effect 6a4faee5 fix freebsd build include path err and so & jar file name c90c48d3 Show More DB Stats in info logs 1b295ac8 DBTest.GetThreadStatus: Wait for test results for longer 25f5742f Update documentation to point at gcc 4.8 b50a81a2 Add a test for tailing_iterator 04751d53 L0 compression should follow options.compression_per_level if not empty 2946cadc Improve RangeDelAggregator documentation 0a9fd05c Update Vagrant file (test internal phabricator workflow) fcd1e0bf Make rocksdb work with internal repo 0aab5e55 FreeBSD: malloc_usable_size is in <malloc_np.h> (#1428) 9c0bb7f1 cmake: drop "-march=native" from CXX_FLAGS (#1429) eeb27e1b Add handy option to turn on direct I/O in db_bench (#1424) c6168d13 removed some declarations from c.h which resulted in undefined symbols (#1407) bc429de4 revert fractional cascading in farward iterator b9bc7a2a Use skiplist rep for range tombstone memtable 60a2bbba Makefile: generate util/build_version.cc from .in file (#1384) 9ee84067 Disable DBTest.RepeatedWritesToSameKey (#1420) f41df304 OptionChangeMigration() to support FIFO compaction 2e8004e6 Changing the legocastle run to use valgrind_test instead of _check 9de2f752 revert Prev() in MergingIterator to use previous code in non-prefix-seek mode 24495186 DBSSTTest.RateLimitedDelete: not to use real clock 1168cb81 Fix a bug that may cause a deleted row to appear again 99c052a3 Fix integer overflow in GetL0ThresholdSpeedupCompaction (#1378) f83cd64c Fix a bug that mistakenly disable regression_test.sh to update commit (#1415) 0e926b84 Passing DISABLE_JEMALLOC=1 to valgrind_check if run locally 4dfaa661 Make IsDeadlockDetect() virtual member of Transaction 59a7c033 Change ioptions to store user_comparator, fix bug 869ae5d7 Support IngestExternalFile (remove AddFile restrictions) 1d9dbef6 Restrict running condition of UniversalCompactionTrivialMoveTest2 4edd39fd Implement deadlock detection 48fd619a Minor fixes to RocksJava Native Library initialization (#1287) 48e4e842 Disable auto compactions in memory_test and re-enable the test (#1408) fb2e4129 column_family_test: disable some tests in LITE 5af651db fix data race in compact_files_test a0ba0aa8 Fix uninitialized variable gcc error for MyRocks b88f8e87 Support SST files with Global sequence numbers [reland] 08616b49 [db_bench] add filldeterministic (Universal+level compaction) 52c9808c not split file in compaciton on level 0 5e0d6b4c fix db_stress assertion failure ab539983 Bump RocksDB version to 4.13 (#1405) b4d07123 SamePrefixTest.InDomainTest to clear the test directory before testing aa09d033 Avoid calling GetDBOptions() inside GetFromBatchAndDB() 6fbe96ba Compaction Support for Range Deletion 257de78d Remove "-Xcheck:jni" from Java tests (#1402) d88dff4e add seeforprev in history 5027dd17 Fix a minor bug in the ldb tool that was not selecting the specified (#1399) fea6fdd6 Fix @see in two Java functions (#1396) b1031d6c Remove function local statics that interfere with memory pooling (#1392) f4705401 Handle WAL deletion when using avoid_flush_during_recovery e29d3b67 Make max_background_compactions and base_background_compactions dynamic changeable 21e8dace fix assertion failure in Prev() b9311aa6 Implement WinRandomRW file and improve code reuse (#1388) a249a0b7 check_format_compatible.sh to use some branch which allows to run with GCC 4.8 (#1393) 040328a3 Remove an assertion for single-delete in MergeHelper::MergeUntil 8cbe3e10 Relax the acceptable bias RateLimiterTest::Rate test be 25% f26a139d Log successful AddFile 5691a1d8 Fix compaction conflict with running compaction 017de666 fixup commit 1b7af5fb Redo handling of recycled logs in full purge 27bfe327 Editorial change to README.md 89cc404d A bit of doc restructuring 9e7fda82 Fix arcanist 2e4b5cab Add missing RateLimiter class to the Windows build (#1382) ce4963fd [doc] Document that Visual Studio 2015+ is now required for Windows builds (#1389) e4892709 Fix scoped arena iterator (#1387) f8d8cf53 Fix log_write_bench -bytes_per_sync option. (#1375) 02b3e398 Make txn->GetState() const 447f1712 new Prev() prefix support using SeekForPrev() 991b585e More block cache tickers d6ae6dec Add Statistics::getAndResetTickerCount(). aea3ce4c Avoid string CONCAT which is not supported in cmake 2.6 (#1383) 2ad68b97 Support running consistency checks in release mode 67501cfc Fix -ve std::string::resize 04b02dd1 Testing asset links after config change 8c55bb87 Make Lock Info test multiple column families d0623289 Revert "Support SST files with Global sequence numbers" 5cd28833 [RocksJava] Adjusted RateLimiter to 3.10.0 (#1368) 37737c3a Expose Transaction State Publicly 2c1f9529 Add facility to write only a portion of WriteBatch to WAL 043cb62d Fix record_size in log_write_bench, swap args to std::string::assign. (#1373) 4985f60f env_mirror: fix a few leaks (#1363) 5aded67d update of c.h (#1371) 912aec13 "Recent Posts" -> "All Posts" 7cbb298d Make sure that when contribtuing we call out creating appropriate directories a06ad471 Add top level doc information to CONTRIBUTING.md 3fdd5b97 A little more generic CONTRIBUTING.md ed4fc31d Add link to CONTRIBUTING.md to main docs README.md e4922e18 Forgot to truncate one blog post 6d8cd7ed Add CONTRIBUTING.md for rocksdb.org contribution guidance bd55e5a1 Fix some formatting of compaction blog post 0f60358b CRLF -> LF mod (including removing trailing whitespace for those files) b90e29c9 Truncate posts on the main /blog/ page 0d7acada Add author fields to blog posts 01be4418 Add GitHub link to the landing page header 9d6c9613 Fix Mac build ab01da54 Support SST files with Global sequence numbers d346ba24 Minor fixes around Windows 64 Java Artifacts (#1366) e91b4d0c Add factory method for creating persistent cache that is accessible from public be1f1092 Expose transaction id, lock state information and transaction wait information 6009c473 Store range tombstones in memtable 3c21c64c Use size hint for HashMap in multiGet. Similar to https://github.com/facebook/rocksdb/pull/1344 (#1367) 13f7a01f Fixing JNI release build for gcc (#975) 7260662b Add Java API for SstFileWriter 26388247 delete unused variable for PrevInterval() 87dfc1d2 Fix conflict between AddFile() and CompactRange() eb44ed65 Update 2016-09-28-rocksdb-4-11-2-released.markdown e4437610 Update 2016-09-28-rocksdb-4-11-2-released.markdown 501f0510 Update 2016-09-28-rocksdb-4-11-2-released.markdown dec9009f Update 2016-09-28-rocksdb-4-11-2-released.markdown 4ed69dd0 Create 2016-09-28-rocksdb-4-11-2-released.markdown 21f4bb5a cmake support for linux and osx (#1358) 4defe306 fix typo in comments (#1360) f517d9dd Add SeekForPrev() to Iterator eb3894cf Recompute compaction score on SetOptions (#1346) 5c64fb67 Fix AddFile() conflict with compaction output [WaitForAddFile()] 9e9f5a0b Fix CompactFilesTest.ObsoleteFiles timeout (#1353) c2a62a4c not cut compaction output when compact to level 0 9ed928e7 Split DBOptions into ImmutableDBOptions and MutableDBOptions 4bc8c88e Recover same sequence id from WAL (#1350) 0a1bd9c5 add cfh deletion started listener da5a9a65 Fix mac build d45eb6c6 Fix typo (#1349) abc0ae46 Add AddFile() InternalStats for Total files/L0 files/total keys ingested 71525633 forbid merge during recovery 5735b3dc Fix compiling under -Werror=missing-field-initializers 654ed9a2 loose the assertion condition of rate_limiter_test e4d3f5d9 Fix DBImpl::GetWalPreallocateBlockSize Mac build error 7afbb742 solve the problem of table_factory_to_write_=nullptr (#1342) d78a4401 DBImpl::GetWalPreallocateBlockSize() should return size_t 42ac9c5f Retry getting arcanist token on failure b666f854 Consider more factors when determining preallocation size of WAL files 4c3f4496 Add TableBuilderOptions::level and relevant changes (#1335) 3edb9461 Avoid hard-coded sleep in EnvPosixTestWithParam.TwoPools 0a88f38b Remove ColumnFamilyData::options() 41a9070f Fix java makefile dependencies 8d9bf5c4 Fix DBOptionsTest.GetLatestOptions 40cfa3e0 Fix DBWALTest.RecoveryWithLogDataForSomeCFs with mac 06b4785f Fix recovery for WALs without data for all CFs d7242ff4 Fix GetSortedWalFiles when log recycling enabled 17f76fc5 DB::GetOptions() reflect dynamic changed options 215d1282 Fix typo (#903) a958c264 Rename jvalue to jval in rocksjni 0a165bd7 Have Facebook link point to RocksDB on FB 3639f328 Fix bug in UnScSigned-off-by: xh931076284 <931076284@qq.com> (#1336) 8e061f97 Refactor GetMutableOptionsFromStrings 81747f1b Refactor MutableCFOptions ba65c816 Support POSIX RandomRWFile 1d980a8e Create CNAME 2adab1dd Add API links to the header bar a182b298 Preserve blog comments in markdown f54de923 Adding Dgraph to list of Users (#1291) 9e4aa798 Summary: (#1313) a10e8a05 Fix C api memtable rep bugs. (#1328) eb1d4d53 Release RocksDB 4.12 22d88e24 Allow an offset as well as a length to be specified for byte[] operations in RocksJava JNI (#1264) b06b1913 add C api for set wal_recovery_mode (#1327) 1cca0912 Temporarily revert Prev() prefix support de28a255 Update HISTORY.md for thread-local stats 0fcb6dbe Remove extraneous function prototypes from c.h (#1326) 52ee07b0 Move AddFile() tests to external_sst_file_test.cc 66a91e26 Add NoSpace subcode to IOError (#1320) 67036c04 Fix Flaky ColumnFamilyTest.FlushCloseWALFiles 0e2da497 fix typo in option.h's comment (#1321) 6d61358a Add real Google Analytics ID 2d9d36ea Have "Edit on GitHub" point to master instead of gh-pages 93775189 Update landing page content 1ec75ee7 Add redirects from old blog posts link to new format 607628d3 Support ZSTD with finalized format ce1be2ce Fix build error on Windows (AppVeyor) (#1315) f7669b40 Fix Windows Build 22696b08 Fix uninitlized CompactionJob::SubcompactionState::current_output_file_size c1865e0f Trigger more tests per diff a88677d2 Remove ImmutableCFOptions from public API 80c75593 Fix data race in AddFile() with multiple files + custom comparator bug 5051755e Fix db_bench memory use after free (detected by clang_analyze) 4fd08f4b Ensure Correct Behavior of StatsLevel kExceptDetailedTimers and kExceptTimeForMutex (#1308) e14fbaae Add FAQ based on the front page of the current rocksdb.org 3c226240 Migrate the RocksDB Worpdress blog over to Jekyll ee0e2201 Transfer the current Getting Started contents to GitHub Pages 5a0e9a4c Initial Landing Page 9447a854 Remove the `doc` directory 32149059 Merge options source_compaction_factor, max_grandparent_overlap_bytes and expanded_compaction_factor into max_compaction_bytes 4590b53a add stats to Cache::LookUp() 85bb3082 Expose Utility function StringToMap() (#1306) 8ce1b844 Fix Travis on Mac 380e651a Fix Mac build failure (#1309) 1613fa94 Thread-specific histogram statistics 6a14d55b add prefix_seek_mode to db_iter_test de47e2bd Fix ClockCache memory leak f099af4c Fix travis db74b1a2 fix bug in merge_iterator when data race happens b18f9c9e add nullptr check to internal_prefix_transform 4e395e87 Update docs README.md 2482d5fb support Prev() in prefix seek mode 7541c7a7 Fix cache_test valgrind_check failure c8513cde Update the download location of Snappy (#1304) b49b92cf Introduce Read amplification bitmap (read amp statistics) c7004840 store prefix_extractor_name in table 4ad928e1 add comment to SimCache to estimate actual capacity e9b2af87 Expose ThreadPool under include/rocksdb/threadpool.h 23a05700 Document memtable flush behavior in CancelAllBackgroundWork() dade61ac Mitigate regression bug of options.max_successive_merges hit during DB Recovery cce702a6 [db_bench] Support single benchmark arguments (Repeat for X times, Warm up for X times), Support CombinedStats (AVG / MEDIAN) 3586901f cat tests logs sorted by exit code b2ce5953 Persist data during user initiated shutdown 4b3438d2 Fix parallel valgrind (valgrind_check) a081f798 Relax consistency for thread-local ticker stats b10d65c2 Update and slightly clarify instructions in build_detect_platform (#1301) f85f99bf Fix the Windows build of RocksDB Java. Similar to https://github.com/facebook/rocksdb/issues/1220 (#1284) 7b810951 Fix a crash when compaction fails to open a file 7c958683 Thread-specific ticker statistics ea9e0757 Add initial GitHub pages infra for RocksDB documentation move and update. (#1294) 2a9c9710 [Flaky Test] Disable DBPropertiesTest.GetProperty d76ddf32 Disable ClockCache db_crashtest cec2c643 fix data race in NewIndexIterator() in block_based_table_reader.cc badbff65 Not insert into block cache if cache is full and not holding handle 4a16c32e Option to cache index/filter blocks with priority 99c4af71 Make ClockCache available with TSAN build f57bc1d0 Fix lambda expression for clang/windows 5440675c Fix lambda capture expression for windows 6584cec8 Fold function for thread-local data 817eeb29 Add singleDelete to RocksJava (#1275) ffdf6eee Add Status to RocksDBException so that meaningful function result Status from the C++ API isn't lost (#1273) ecf90038 Fix bug in printing values for block-based table 72f8cc70 LRU cache mid-point insertion 6a17b07c Add TablePropertiesCollector support in SstFileWriter 78837f5d TableBuilder / TableReader support for range deletion 4cc37f59 Introduce ClockCache ff17a2ab Adding TBB as dependency. 49d88be0 c abi: allow compaction filter ignore snapshot (#1268) 0b63f51f fixes 1215: execute_process(COMMAND mkdir ${DIR}) fails to create a directory with cmake on Windows (#1219) 3981345b Small nits (#1280) 2a2ebb6f Move LRUCache structs to lru_cache.h header 2fc2fd92 Single Delete Mismatch and Fallthrough statistics 3771e379 WriteBatch support for range deletion 236756f2 Make SyncPoint return immediately when disabled 64a0082c Fix DBSSTest::AddExternalSstFileSkipSnapshot valgrind fail dd7a748c Fix java build 4fe12baa Make db_bench less space for --stats_per_interval 6525ce4c Compaction stats printing: "batch" => "commit group" a117891b Fixed typo (#1279) b248e98c Fix a destruction order issue in ThreadStatusUpdater deda159b Added min/max/avg data block size output to sst_dump e408e98c add Name() to Cache a297643f Fix valgrind memory leak d11c09d9 Eliminate memcpy from ForwardIterator d3675550 Added further Java API options for controlling concurrent writes ebdfe34c Exposed further Java API options for controlling compaction d1be5946 Improve documentation of SliceTransform. 6056d631 Improve comment and bug fix for GetOptionsFromMap functions in convenience.h 76a67cf7 support stackableDB as the baseDB of transactionDB 67c1ae88 Travis build break fix b693ba68 Minor PinnedIteratorsManager Refactoring db3dfb16 Fixes for arcanist config (#1271) 87c91bd8 Persistent Read Cache (8) Benchmark tooling 2914de64 add sim_cache stats to Statistics 8b79422b [Proof-Of-Concept] RocksDB Blob Storage with a blob log file. 4beffe00 Fix test data race in two FaultInjectionTest tests 821bcb0b util/arena.cc: FreeBSD: More portable use of mmap(MAP_ANON) (#1254) 5370f44a Increase RocksDB version 56dd0341 read_options.background_purge_on_iterator_cleanup to cover forward iterator and log file closing too. ccecf3f4 UniversalCompaction should ignore sorted runs being compacted (when compacting for file num) 1b0069ce Remove non-gtest from parallelized tests 638c49f2 Change HISTORY.md for release 4.11 6b8e9c68 fix vs generator (#1269) c38b075e Update HISTORY.md 8f399e3f Update HISTORY.md 98d0b78e Added check_snapshot option in the DB's AddFile function (#1261) 9fd68b7f set travis open file descriptor limit 59ddb505 Fix travis build break f4d98636 Added SetOptions support to RocksJava (#1243) 7882cb97 Make DBOptionsTest::EnableAutoCompactionAndTriggerStall less falky 44f5cc57 Add time series database (resubmitted) 7c4615cf A utility function to help users migrate DB after options change 5bb0a7f7 Update appveyor.yml 86396cc1 Update appveyor.yml c1db098d Update appveyor.yml 7da2eaf0 Update appveyor.yml 34723b4c Cleanup unused variable pending_fsync_. 7cc0dbd6 cat all logs in sandcastle output 9253767a Correct geHistogramData() -> getHistogramData() (#1257) f35b16f2 db_bench add an option of --base_background_compactions c3a4bea5 Fix flaky test `ObsoleteFiles` 8234faab Fix failed test 4990c0d1 Remove deprecated LEVELDB_PLATFORM_POSIX 7323e4c8 Fix clang on macOS ee027fc1 Ignore write stall triggers when auto-compaction is disabled e4609a74 Fix Windows build issues (#1253) 2306167d Fix clang build failure and refactor unit test 343304e1 Use StopWatch to do statistic job in db_impl_add_file.cc cdc4eb68 Add a GetComparator() function to the ColumnFamilyHandle base class so that the user's comparator can be retrieved. 712dd27e Build break fixes 0155c73d Fix parallel tests `make check -j` c49ea68c Fix to enable running CI jobs locally 726c2f7e Build break fix d51dc96a Experiments on column-aware encodings c116b478 Persistent Read Cache (part 6) Block Cache Tier Implementation 64046e58 Write a benchmark to emulate time series …
* Squashed 'rocksdb-sys/rocksdb/' changes from 98084910..6f35cb93 6f35cb93 bump version c1565071 update history dd0efa4e Preserve overlapping file endpoint invariant aead4041 fix HISTORY.md typo a0cdc3ce Bump version to 5.8.7 7513f635 Fix IOError on WAL write doesn't propagate to write group follower 9e47084c Bump version to 5.8.6 36074ba5 Enable cacheline_aligned_alloc() to allocate from jemalloc if enabled. aa00523e Add -DPORTABLE=1 to MSVC CI build cf2b9823 Bump version to 5.8.5 e8c9350f Blob DB: not using PinnableSlice move assignment 4907d246 Bump version to 5.8.4 5d928c79 Blob DB: Fix race condition between flush and write 725bb9d6 Blob DB: Fix release build b7367fe8 Bump version to 5.8.3 13b2a9b6 Blob DB: use compression in file header instead of global options 5dc70a15 Fix PinnableSlice move assignment 9019e912 dynamically change current memtable size 7f1815c3 Bump version to 5.8.2 2584a18e Blob DB: Fix BlobDBTest::SnapshotAndGarbageCollection asan failure 17f67b54 PinnableSlice move assignment 6fb56c58 Blob DB: Add compaction filter to remove expired blob index entries f90ced92 Blob DB: fix snapshot handling 632f36dc Blob DB: option to enable garbage collection 11bacd57 Blob DB: Fix flaky BlobDBTest::GCExpiredKeyWhileOverwriting test f98efcb1 Blob DB: Evict oldest blob file when close to blob db size limit c1e99edd Blob DB: cleanup unused options ffc3c62c Blob DB: Initialize all fields in Blob Header, Footer and Record structs 9e825409 Blob DB: update blob file format d66bb21e Blob DB: Inline small values in base DB 05d5c575 Return write error on reaching blob dir size limit 2b8893b9 Blob DB: Store blob index as kTypeBlobIndex in base db 419b93c5 Blob DB: not writing sequence number as blob record footer 8afb0036 fix lite build dded348d Blob DB: Move BlobFile definition to a separate file 37473612 add GetLiveFiles and GetLiveFilesMetaData for BlobDB 8cff6e94 Enable WAL for blob index c2934729 Add ValueType::kTypeBlobIndex eae53de3 Make it explicit blob db doesn't support CF 65aec19d Fix memory leak on blob db open 30b38c98 TableProperty::oldest_key_time defaults to 0 2879f4be Bump version to 5.8.1 88595c88 Add DB::Properties::kEstimateOldestKeyTime 266ac245 Bumping version to 5.8 64185c23 update HISTORY.md for DeleteRange bug fix e83d6a02 Not using aligned_alloc with gcc4 + asan 0980dc6c Fix wrong smallest key of delete range tombstones b7679723 avoid use-after-move error c4174427 CMake: Fix formatting c21ea8f7 CMake: Add support for CMake packages 54443455 add Erlang to the list of language bindings 2972a702 Minor updates to FlushWAL blog fbfa3e7a WriteAtPrepare: Efficient read from snapshot list b01f426f Blog post for FlushWAL 503db684 make blob file close synchronous 3c840d1a Allow DB reopen with reduced options.num_levels 92bfd6c5 Fix DropColumnFamily data race 7fdf735d Pinnableslice examples and blog post 7fbb9ecc support disabling checksum in block-based table 19cc66dc fix clang bug in block-based table reader 7eba54eb test compaction input-level split range tombstone assumption cd26af34 Add unit test for WritePrepared skeleton a1247981 Improved transactions support in C API c10b3913 LANGUAGE-BINDINGS.md: add another rust binding 90177432 Remove leftover references to phutil_module_cache 234f33a3 allow nullptr Slice only as sentinel ccf7f833 Use PinnableSlice in Transactions 1dfcdb15 Extend pin_l0 to filter partitions 39ef9005 stop calling memcmp with nullptrs 78cb6b61 Provide byte[] version of SstFileWriter.merge to reduce GC Stall 867fe92e Scale histogram bucket size by constant factor f004307e CMake improvements 09ac6206 Circumvent ASAN false positive 5b68b114 Blob db create a snapshot before every read 4624ae52 GC the oldest file when out of space 8ace1f79 add counter for deletion dropping optimization 0d8e992b Revert the mistake in version update 5358a805 add VerifyChecksum to HISTORY.md ed0a4c93 perf_context measure user bytes read 1efc600d Preload l0 index partitions bddd5d36 Added mechanism to track deadlock chain c1384a70 fix db_stress uint64_t to int32 cast 29877ec7 Fix blob db crash during calculating write amp 8f2598ac Enable Cassandra merge operator to be called with a single merge operand 9a44b4c3 Allow merge operator to be called even with a single operand ac8fb77a fix some misspellings 23593171 minor improvements to db_stress af012c0f fix deleterange with memtable prefix bloom 1c8dbe2a update scores after picking universal compaction eb642530 Update WritePrepared with the pseudo code 132306fb Remove PartialMerge implementation from Cassandra merge operator 71598cdc Fix false removal of tombstone issue in FIFO and kCompactionStyleNone 3204a4f6 Fix missing stdlib include required for abort() 7aa96db7 db_stress rolling active window dfa6c23c Update RocksDBCommonHelper to use escapeshellarg e367774d Overload new[] to properly align LRUCacheShard ad42d2fc Remove residual arcanist_util directory 279296f4 properly set C[XX]FLAGS during CMake configure-time checks c5f0c6cc compile with correct flags to determine SSE4.2 support 185ade4c cmake: support more compression type 5449c099 rocksdb: make buildable on aarch64 a144a978 Fix for CMakeLists.txt on Windows for RocksJava acf935e4 fix deletion dropping in intra-L0 8254e9b5 make sst_dump compression size command consistent 74f18c13 db_bench support for non-uniform column family ops 5de98f2d approximate histogram stats to save cpu 3f588843 Fix c_test ASAN failure e5a1b727 Fix blob DB transaction usage while GC 6f051e0c fix corruption_test valgrind ac098a46 expose set_skip_stats_update_on_db_open to C bindings 666a005f Support prefetch last 512KB with direct I/O in block based file reader ad77ee0e Revert "Makefile: correct faligned-new test" b87ee6f7 Use more keys per lock in daily TSAN crash test 25df2425 Add column families related functions (C API) 64f84843 block_cache_tier: fix gcc-7 warnings 0cecf815 Write batch for `TransactionDB` in C API 6a9de434 Windows.h macro call fix 23c7d135 fix comment 1fbad84b Makefile: correct faligned-new test 7848f0b2 add VerifyChecksum() to db.h 47ed3bfc fix WinEnv assertions d97a72d6 Try to repair db with wal_dir option, avoid leak some WAL files 36375de7 gcc-7/i386: markup intentional fallthroughs bdc056f8 Refactor PessimisticTransaction a9a4e89c Fix valgrind complaint about initialization 4ca11b4b Update USERS.md c9804e00 Refactor TransactionDBImpl 20dc5e74 Optimize range-delete aggregator call in merge helper. 0d4a2b73 Avoid blob db call Sync() while writing 627c9f1a Don't add -ljemalloc when DISABLE_JEMALLOC is set dce6d5a8 db_bench background work thread pool size arguments 4f81ab38 Makefile: fix for GCC 7+ and clang 4+ 92afe830 Update all blob db TTL and timestamps to uint64_t 5883a1ae Fix /bin/bash shebangs cc01985d Introduce bottom-pri thread pool for large universal compactions 0b814ba9 Allow concurrent writes to blob db 2c45ada4 Blob DB garbage collection should keep keys with newer version 58410aee Fix the overflow bug in AwaitState c3d5c4d3 Refactor TransactionImpl 060ccd4f support multiple CFs with OPTIONS file 34538706 Fix statistics in RocksJava sample 1900771b Dump Blob DB options to info log 3218edc5 Fix universal compaction bug 6a36b3a7 fix db get/write stats a84cee81 Add a missing "once" in .h 21696ba5 Replace dynamic_cast<> e85f2c64 Prevent empty memtables from using a lot of memory ac748c57 Fix FIFO Compaction with TTL tests aaf42fe7 Move blob_db/ttl_extractor.h into blob_db/blob_db.h aace4651 Fix license headers in Cassandra related files 50a96913 CacheActivityLogger, component to log cache activity into a file 6083bc79 Blob DB TTL extractor 710411ae fix asan/valgrind for TableCache cleanup 3a3fb00b TARGETS file not setting sse explicitly fca4d6da Build fewer tests in Travis platform_dependent tests 8f553d3c remove unnecessary internal_comparator param in newIterator 7f6d012d "ccache -C" in Travis d12691b8 move TableCache::EraseHandle outside of db mutex f33f1136 fix db_bench argument type e7697b8c Fix LITE unit tests 3ce20e98 Fix use of RocksDBCommonHelper in cont_integration.sh c281b448 Revert "CRC32 Power Optimization Changes" 9980de26 Fix FIFO compaction picker test 2289d381 CRC32 Power Optimization Changes 30b58cf7 Remove the orphan assert on !need_log_sync fe1a5559 Fix flaky write_callback_test addbd279 5.6.1 release blog post 30edff30 buckification: remove explicit `-msse*` compiler flags 2b259c9d Lower num of iterations in DeadlockCycle test 277f6f23 Release note for partitioned index/filters 5e731a13 Remove unused rocksdb arcanist lib 9b11d434 Fix broken links 06f19174 add vcpkg as an windows option ea8ad4f6 Fix compaction div by zero logging 34112aef Added db paths to c 1d8aa296 Gcc 7 ParsedInternalKey replace memset with clear function. a4c42e80 Fix UBSAN issue of passing nullptr to memcmp 16e03882 LRUCacheShard cache line size alignment 216644c6 enable UBSAN macro in TARGETS e67b35c0 Add Iterator::Refresh() a34b2e38 Fix caching of compaction picker's next index 72502cf2 Revert "comment out unused parameters" 1d7048c5 comment out unused parameters 534c255c Cassandra compaction filter for purge expired columns and rows 63163a8c Remove make_new_version.sh 0302da47 Reduce blob db noisy logging 3e5ea29a Fix Flaky DeleteSchedulerTest::ImmediateDeleteOn25PercDBSize a22b9cc6 overlapping endpoint fixes in level compaction picker ffd2a2ee delete ExpandInputsToCleanCut failure log 3e6e863b Remove arcanist_util directory 36651d14 Moving static AdaptationContext to outside function 6e3ee015 Update java/rocksjni.pom ecff9d5e Include write_buffer_manager in ImmutableDBOptions::Dump ae28634e Remove some left-over BSD headers 33b1de82 Remove format compatibility hack 2f375154 checkout local branch in check_format_compatible.sh ddb22ac5 avoid collision with master branch in check format 0c03a7f1 set the remote for git checkout 7ac184c6 Revert cmake -DNDEBUG for non-MSVC 0655b585 enable PinnableSlice for RowCache 00464a31 Fix column_family_test with LITE build b2dd192f tools/write_stress.cc: Correct "1204" typos. cbaab304 table/block.h: change memset f1a056e0 CodeMod: Prefer ADD_FAILURE() over EXPECT_TRUE(false), et cetera 4a2e4891 Add back the LevelDB license file a7321fc9 Remove the licensing description in CONTRIBUTING.md 3c327ac2 Change RocksDB License 13201336 Make TARGETS file portable ccf5f08f Set CACHE_LINE_SIZE for s390, PPC, ARM64 67510eef db_crashtest.py: remove need for shell 4267eb00 Remove punit tests 5bfb67d9 Enable write rate limit for updaterandom benchmark 20a691d9 Update HISTORY to release 5.7 98d1a551 db_bench to by default verify checksum 26ce69b1 Update blob db to use ROCKS_LOG_* macro 43e4eef7 remove unnecessary fadvise 21b17d76 Fix BlobDB::Get which only get out the value offset 70440f7a Add virtual func IsDeleteRangeSupported 7550255c Add JAVAC_ARGS as Makefile variable 7a0b5de7 Gcc 7 ignored quantifiers 000bf0af Improve the design and native object management of Stats in RocksJava 269d383d Bump version to 5.7 c32f2722 Fixes db_bench with blob db fcd99d27 db_bench_tool: fix buffer size 87128bd5 fix regression test 8f927e5f Fix undefined behavior in Hash 643b787c Added a note about LZ4 compression dependency 56656e12 Temporarily disable FIFOCompactionWithTTLTest b5fb85ec fix valgrind init complaint 657df29e Add max_background_jobs to db_bench a43c053a remove duplicated utilities/merge_operators/cassandra/test_utils.cc in src.mk 7c4a9e6c Initialize a variable in ldb to make code analysis tool happy 98669b53 init filters_in_partition_ 0013bf14 fix asan and valgrind leak report in test 521b4c28 rocksdb 5.5.1 release post 33042573 Fix GetCurrentTime() initialization for valgrind f6b9d935 Fix clang error in PartitionedFilterBlockBuilder 45b9bb03 Cut filter partition based on metadata_block_size f4ae1bab update history for OnBackgroundError and DeleteRange fix 1cb8c6de Add -enable_pipelined_write to db_bench and add two defaults 7604b463 Update the AddDBStats in LITE 1e34d07e Simplify and document sync rules for logs_ etc d310e0f3 Regression test for empty dedicated range deletion file e9f91a51 Add a fetch_add variation to AddDBStats c1b375e9 skip generating empty sst 67b417d6 fix format compatible test afbef651 Bug fix: Fast CRC Support printing is not honest 397ab111 Improve Status message for block checksum mismatches 18c63af6 Make "make analyze" happy 01534db2 Fix the reported asan issues 1cd45cd1 FIFO Compaction with TTL 982cec22 Fix TARGETS file tests list b49b3710 allow numa >= 2.0.8 e517bfa2 CLANG Tidy dc3d2e4d update compatible test 89468c01 Fix Windows build broken by 5c97a7c0664d4071768113814e9ba71fe87e18cf 51778612 Encryption at rest support 7061912c Trivial typo in HISTORY.md 2a9cd879 Fix jni WriteBatchThreadedTest 0025a364 revert perf_context and io_stats to __thread 5c97a7c0 Unit Tests for sync, range sync and file close failures 4cee11f4 Intra-L0 blog post 857e9960 Improve the error message for I/O related errors. d757355c Fix bug that flush doesn't respond to fsync result 8e6345d2 Update rename of ParanoidCheck 499ebb3a Optimize for serial commits in 2PC 0ac4afb9 Sanitize partitioning options 521724ba fixed wrong type for "allow_compaction" parameter 71f5bcb7 Introduce OnBackgroundError callback 88cd2d96 Downgrade option sanitiy check level for prefix_extractor 6837a176 Fix Data Race Between CreateColumnFamily() and GetAggregatedIntProperty() af174675 WriteBufferManager will not trigger flush if much data is already being flushed 9467eb61 Fix flush assertion with tsan 048446fc Fix cassandra ASAN use-after-free a21db161 Implement ReopenWritibaleFile on Windows and other fixes c430d69e fix coredump for release nullptr 0d278456 default implementation for InRange cbd825de Create a MergeOperator for Cassandra Row Value 2c98b06b Remove pin_slice option by making it the default c80c6115 add db_bench options for partitioning 6a3377f4 Synchronize statistic enumeration values between statistics.h and java API 53dda879 Do not run RateLimiterTest.Rate test on Travis+Mac OSX. ae8571f5 Fix blob db compression bug 7a380def Update blob_db_test 89ad9f3a Allow ignoring unknown options when loading options from a file 6b5a5dc5 fixed typo 0f228be3 fixed typo in util/dynamic_bloom.h c217e0b9 Call RateLimiter for compaction reads 91e2aa3c write exact sequence number for each put in write batch 6f4154d6 record index partition properties 5d5a28a9 Fix Clang release build broken by 5582123dee8426a5191dfd5e846cea8c676c793c 0175d58c Make direct I/O write use incremental buffer 7a270069 GNU C library for struct tm has 2 additional fields. d713471d Limit trash directory to be 25% of total DB 9bb91e93 Dedup release 27b45016 Update HistogramTypes in the Java API e97304c6 update history for 5.6 5582123d Sample number of reads per SST file db818d2d Fix RocksDB Lite build with CLANG a472c4ae update 5.5 change log bc09c8a0 Fix crash in PosixWritableFile::Close() when fstat() fails 6d0f22e4 Fix mock_env.cc uninitialized variable c2012d48 Java APIs for put, merge and delete in file ingestion 85dace2a Disable DBRangeDelTest::TailingIteratorRangeTombstoneUnsupported for ubsan d4f7731b fix travis error with init time in mockenv 550a1df7 Fix clang errors by asserting the precondition cc5f9339 Fix concurrency issue with filter_block_set_ 2e64f450 bump version to 5.6 afbc2d0d Force travis to build with clang on MacOS b172a3f1 Fix warnings while generating RocksJava documentation 52a7f38b WriteOptions.low_pri which can throttle low pri writes if needed 26a8a807 Switch from CentOS 5 to CentOS 6 for crossbuilding RocksJava dba9f372 Fix db_write_test clang/windows build failure c7662a44 fixed typo 7e8d95cc Fix the Java build which was broken by a4d9c02 7e5fac2c remove test dir before exit when current regression is running 7f6c02dd using ThreadLocalPtr to hide ROCKSDB_SUPPORT_THREAD_LOCAL from public… 138b87ea Fix interaction between CompactionFilter::Decision::kRemoveAndSkipUnt… 95b0e89b Improve write buffer manager (and allow the size to be tracked in block cache) a4d9c025 Pass CF ID to MemTableRepFactory f68d88be Fix DBWriteTest::ReturnSequenceNumberMultiThreaded data race 215076ef Fix TSAN: avoid arena mode with range deletions 3a8a848a account for L0 size in estimated compaction bytes 0fae3f5d codemod: format TARGETS with buildifier [5/5] (D5092623) 87219960 add checkpoint support for single db in regression test 5a9b4d74 Retire memenv https://github.com/facebook/rocksdb/pull/2082 d6019651 sync internal/external TARGETS bbaba51b Add missing index type to C-API 292edfd5 travis: test with xcode8.3 (OS X 10.12) 0dc3040d db: avoid `#include`ing malloc and jemalloc simultaneously 9b3ed835 fix regression test 9c9909bf Support ingest file when range deletions exist ad19eb86 Fixing blob db sequence number handling 51ac91f5 Histogram of number of merge operands 345878a7 update blob_db_test cbc821c2 change regression rebuild to one level 103d0692 Avoid unsupported attributes when not building with UBSAN 5fd04566 travis: reduce the number of travis builders 2d05002b RocksDB 5.4.5 release blog post 7eca90f1 Update RocksDB blog authors d03c3449 update comment of GetNextFile f7bb1a00 support merge and delete in file ingestion c2c62ad4 Reorder variables of ReadOptions 7bb1f5d4 Increase of compaction threads should be logged at info level instead of a warning 6c456eca Clean zstd files 347e16f8 codemod: replace `headers = AutoHeaders.*` with `auto_headers` 0be636bf Fix db_bench build break with blob db 135ee6a3 fix tsan crash data race a99fb992 fix column_family_test asan f41bffb3 travis: clang-3.6 -> clang-4.0 e7612798 update buckifer/TARGETS bb01c188 Introduce max_background_jobs mutable option 5a253046 Fix the CMakeLists for RocksJava 41cbb727 options.delayed_write_rate use the rate of rate_limiter by default. 50680346 range sync should be enabled 02594b5f Fix build errors in blob_dump_tool with GCC 4.8 52d9e5f7 Fix column family seconds_up accounting 7d8207f1 Fix errors in clang-analyzer builds 85b8569a Fix release build on Linux 69ec8356 Allow SstFileWriter to use the rate limiter 6cc9aef1 New API for background work in single thread pool 9d0a07ed Fix rocksdb.estimate-num-keys DB property underflow 578fb0b1 Simple blob file dumper ac39d6be Core-local statistics 3e86c0f0 disable direct reads for log and manifest and add direct io to tests 15ba4d6c Address MS Visual Studio 2017 issue with autovector 88c818e4 Replace deprecated RocksDB#addFile with RocksDB#ingestExternalFile 228f49d2 Fix data races caught by tsan 4c9d2b10 remove #include port/port.h in public header file 07bdcb91 New WriteImpl to pipeline WAL/memtable write d746aead Suppress clang-analyzer false positive 217b866f column_family_test: EnvCounter::num_new_writable_file_ to be atomic 9f839a7f keep util/build_version.cc when make clean 7eecd40a add emacs tags file - etags 9bbba4fe Remoe unused BlockBasedTable::compaction_optimized_ f5ba131b Fixed some spelling mistakes 146b7718 Fix mingw compilation with -DNDEBUG a36220cc fix unity test 0ebdd705 fixed typo 8032f4cb Remove -pie in TSAN 362ba9b0 Release RocksDB 5.5.0 ba685a47 Support ingest_behind for IngestExternalFile 01ab7b52 Add ROCKSDB_LIBRARY_API macro to a few C APIs, to fix windows build cb9392a0 add Transactions and Checkpoint to C API 445f1235 s/std::snprintf/snprintf cd593c28 Fix travis java_test f720796e fixed typo a48a62d5 define NDEBUG in CMake non-debug builds 1ca723db C API: support pinnable get 2ef15b85 Core-local stats blog post 4f9e69cc fix log err 11c5d474 cross-platform compatibility improvements d0043330 Put lib files into suitable path in RPM package 86d54925 Fix build error with blob DB. 254c4680 Fix the RocksJava Release on Windows 7a47b431 Fix .gitignore pattern fa5a15ce Make sure that zstd is statically linked correctly in the Java static build 3fa9a39c Add GetAllKeyVersions API 1a60982a Simplified instructions for CentOS a5cc7ece Facility for cross-building RocksJava using Docker ccd3dddf Blog post for partitioned index/filters b145c34d Update blog authors bbe9ee7d core-local array type conversions c2be4343 Build and link with ZStd when creating the static RocksJava build c61e72c4 Add missing files of blob_db to CMake file 3907c94f Fix ColumnFamilyTest:BulkAddDrop cda5fde2 CoreLocalArray class 93949667 update TARGETS 4e83b800 title: Bulkoading -> title: Bulkloading d85ff495 Blob storage pr 492fc49a fix readampbitmap tests be421b0b portable sched_getcpu calls 0f559abd Add NO_UPDATE_BUILD_VERSION option to makefile 3a04a254 Flink state 35df23fe Fix suite exclisions e7cea86f Fixes the CentOS 5 cross-building of RocksJava 259a00ea unbiase readamp bitmap a6209669 port: updated PhysicalCoreID() df035b68 Print compaction_options_universal.stop_style in LOG file 4897eb25 dont skip IO for filter blocks 3f73d54b Add C API to set max_file_opening_threads option 0b69e507 Define CACHE_LINE_SIZE only when it's not defined 2cd00773 Add bulk create/drop column family API 40af2381 Object lifetime in cache fdaefa03 travis: add Windows cross-compilation a30a6960 do not read next datablock if upperbound is reached 2d42cf5e Roundup read bytes in ReadaheadRandomAccessFile 264d3f54 Allow IntraL0 compaction in FIFO Compaction 8c3a180e Set lower-bound on dynamic level sizes 7c1c8ce5 Avoid calling fallocate with UINT64_MAX a45e98a5 max_open_files dynamic set, follow up 6b99dbe0 fix memory alignment with logical sector size e7ae4a3a Max open files mutable 60847a3b port: updated PhysicalCoreID() b551104e support PopSavePoint for WriteBatch 498693cf Remove orphaned Java classes 5e2ebf2b travis: add CMake compilation af6fe69e Fix an issue of manual / auto compaction data race 6798d1f3 Revert "Delete filter before closing the table" 89833577 Delete filter before closing the table 47a09b0a Avoid pinning when row cache is accessed aeaba07b Remove an assert that causes TSAN failure. 0b90aa95 Set VALGRIND_VER a2b05210 Make PosixLogger::flush_pending_ atomic da4b2070 Fix WriteBatchWithIndex address use after scope error d616ebea Add GPLv2 as an alternative license. 4439b459 Add documentation license 0ca3ead0 add GetRootDB() in DeleteFilesInRange cdad04b0 Remove double buffering on RandomRead on Windows. e15382c0 Disable two flaky tests 2150cc1f fix WritableFile buffer size in direct IO efc361ef Add user stats Reset API 6616e4d6 add prefetch to PosixRandomAccessFile in buffered io f6a27d0b Extract statistics tests into separate file 7eddecce support bulk loading with universal compaction 3b4d1b7a add <sys/sysmacros.h> to avoid warning with glibc 2.25 e5e545a0 Reunite checkpoint and backup core logic 72c21fb3 call GetRootDB() before cast to DBImpl* in CancelAllBackgroundWork 4c9447d8 Add erase option to release cache 04d58970 AIX and Solaris Sparc Support afff9951 Respect deprecated flag in table options 066cfbac Adding -noprofile to CMakeLists for Windows cb885bcc set compaction_iterator earliest_snapshot to max if no snapshot 7534ba7b StackableDB should pass ResetStats() c1fbf91b Fixing Solaris Sparc crash due to cached TLS 963eeba4 Revert how check_format_compatible.sh checkout release branches. 97005dbd tools/check_format_compatible.sh to cover option file loading too 8f619678 Add cpu usage to regression benchmarks (4th attempt) df74b775 Limit backups opened 1dd77605 Change L0 compaction score using level size 927bbab2 Revert "Add cpu usage to regression benchmarks (3rd attempt)" 8e84a388 Re-add index_per_partition but as deprecated 1553659d Add more recent versions to tools/check_format_compatible.sh 966ebb02 Hide event listeners from lite build 476e80be Add cpu usage to regression benchmarks (3rd attempt) c49d7046 Add DB:ResetStats() 0fcdccc3 Blob storage helper methods a6439d79 CMake: compile with -O2 e67f0adf enable O2 optimization for lz4 bc397325 CMake: add support for SSE4.2 7d5f5aa9 Separate compile and link for shared library 07165273 remove warning 6e8d6f42 readahead backwards from sst end ca96654d Change Build Env to gcc-5 e9e6e532 Simplify write thread logic 6799c7e0 Pass in remote as a param to branch creation script 44fa8ece change use_direct_writes to use_direct_io_for_flush_and_compaction 13b50358 add space for buggy kernel warning b6b9359e Fix BYTES_WRITTEN accounting 13369fbd Update ShipIt to honor TARGETS updates f2449ce9 Remove .deprecated_arcconfig 415be221 RocksDB Release 5.4 : Update HISTORY.md and build version. 3eab41d7 java dependencies test -s -> use test -d a22ed4ea internal_repo_rocksdb to build Java and RocksDB LITE 9f2cc59e sync TARGETS file 10d75469 set readahead buffer size from roundup(user_size) + 4k to roundup(use… ba7da434 fix db_stress crash caused by buggy kernel warning 6257837d Add ROCKSDB_JAVA_NO_COMPRESSION flag 6a6723ee Move MergeOperatorPinning tests to be with other merge operator tests 6a8d5c01 Revert "Report cpu usage using time command" 8f47a975 File level histogram should be printed per CF, not per DB 9300ef54 Fix shared lock upgrades 1f8b119e Limit maximum memory used in the WriteBatch representation 97ec8a13 Report cpu usage using time command 20778f2f Adding comments to the write path 7124268a Reduce the number of params needed to construct DBIter 04abb2b2 FreeBSD only requires WITH_JEMALLOC, not the rest 61730186 dummy diff 360e9960 Summary: Remove .arcconfig 69a5e646 Deprecate .arcconfig 9690653d Add a verify phase to benchmarks dd8f9e38 Fix compilation for GCC-5 c2954f9b Add Travis job to build examples 72fc1e9d avoid non-existent O_DIRECT on OpenBSD ff972870 Refactor compaction picker code 9e729390 only FALLOC_FL_PUNCH_HOLE when ftruncate is buggy 343b59d6 Move various string utility functions into string_util 1d068f60 Fix CompactRange incorrect buffer release df6f5a37 Move memtable related files into memtable directory 107c5f6a CMake: more MinGW fixes d2dce561 Move some files under util/ to separate dirs c50e3750 Use a human readable size for level report ce64b8b7 Divide db/db_impl.cc 02799ad7 Revert "delete fallocate with punch_hole" e2a7b202 Release note for partition filters af256eb2 build db every monday e5a1372b Rework test running script. d659faad Level-based L0->L0 compaction a12306fa Add a notice on gflags installation in INSTALL.md 43010a92 Revert "[rocksdb][PR] CMake: more MinGW fixes" a30b75cd Add buckifier script to github repo 3450ac8c CMake: more MinGW fixes 90cfd464 update IterKey that can get user key and internal key explicitly e2c6c063 add TimedEnv 9e445318 Refactor WriteImpl (pipeline write part 1) 6ef8c620 Move auto_roll_logger and filename out of db/ a1c469d7 Add release notes for PinnableSlice 0537f515 fix run_remote with strong quoting 72e60009 fixed misses on Centos library installation instructions 88cc81df auto_roll_logger_test to move away from real sleep d25e28d5 replace sometimes-undefined uint type with unsigned int a1d7e487 Add L0 write-amp to compaction level stats b6d60906 CMake: support AVX2 in MinGW bd7d1383 test remote instead run remote in regression test c81a805f test db existence on the remote host 5fc1e676 add -rf when remove db in regression test 4ab4049f gflags has moved to GitHub 4e006501 make all DB::Get overloads virtual 6401a8b7 Fix build with MinGW 80fe5b38 disable test: DeleteSchedulerTest.DynamicRateLimiting1 a9c86f51 backup garbage collect shared_checksum tmp files da175f7e exit with code 2 when there is already a db_bench running in regression test 0ee7f040 Added missing options to RocksJava c6d04f2e Option to fail a request as incomplete when skipping too many internal keys 58179ec4 Cleanup of ThreadStatusUtil structures should use the DB's reference f3607640 add ldb build to regression test 8a8c9674 Enable Fast CRC32 for Win64 f9813b85 Added SstFileWriter construtor without explicit comparator to JNI api 8d3cb4f2 Added naming of backup engine threads 67d76237 Expose the stalling information through DB::GetProperty() 0fd57492 delete fallocate with punch_hole 41fe9ad7 Hide usage of compaction_options_fifo from lite build e7731d11 Configure index partition size 69c8d524 Fix jni library name for PowerPC Architecture 34a70859 Fix segmentation fault caused by #1961 8dee8cad Enable fifo compaction benchmark to db_bench a5c8b543 fix a header include 91b5feb3 Fix Windows Build broken by a recent commit 41ccae6d Add C API functions (and tests) for WriteBatchWithIndex 88bb6f6b non_shm CI should run tests on /tmp 8888de2b Update .gitignore file in examples 203136e7 Fix Compilation errors when using IBM Java f4fce475 Fix clang compile error - [-Werror,-Wunused-lambda-capture] a084b26a Blog post for releasing 5.2.1 15950fe3 Remove ASSERT_EQ(boolean, ...) 3e56c7e0 make total_log_size_ atomic 909028e2 HISTORY.md for log_size_for_flush in CreateCheckpoint() be723a8d Optionally construct Post Processing Info map in MemTableInserter e474df94 db_bench: not need to check mmap for PlainTable 8b0097b4 Readers for partition filter 9ef3627f Allow checkpointing without flushing 17866ecc Allow Users to change customized ldb tools' header in help printing a2a88331 remove deleted option from benchmark.sh 78cb1955 add checkpoint to ldb 4b04addf updated solution if "make format" command fails 8f5bf044 Flush triggered by DB write buffer size picks the oldest unflushed CF 6908e24b dynamic setting of stats_dump_period_sec through SetDBOption() 93c68b64 change regression bash file with debug mode 21d8c317 remove LIKELY from public headers 36ad7577 INSTALL: document USE_SSE 9272e12f avoid ftruncate twice in buffered io d52f334c Break stalls when no bg work is happening e66221ad fix db_bench rate limiter callsites dbae438a Replace "DEPRECATED" comment to "not supported" 995618a8 Support SstFileManager::SetDeleteRateBytesPerSecond() e1916368 Add macros to include file name and line number during Logging d525718a cleanup direct io flag in WritableFileWriter 5fa927aa Add Xpress and ZSTD CompressionType values to C header 11526252 Pinnableslice (2nd attempt) e5bd8def update history.md for fixing the bug that skips keys 1ffbdfd9 Add a new SstFileWriter constructor without explicit comparator ebd5639b Add ability to search for key prefix in sst_dump tool e6725e8c Fix some bugs in MockEnv 900c62be fix compile for VS2015 fe183561 release 5.3 5dae0194 Revert "Report cpu usage using time command" f2817fb7 avoid ASSERT_EQ(false, ...); 5b11124e add max to histogram stats d43adf21 Report cpu usage using time command 18fc1bc0 minor changes for rate limiter test flakiness 12ba00ea Reset DBIter::saved_key_ with proper user key anywhere before pass to DBIter::FindNextUserEntry c9df05d1 Fix random access alignment f6499153 Add Bulkoading IngestExternalFile blog post 54b43411 Builders for partition filter 97edc72d Add a memtable-only iterator 72202962 fix db_sst_test flakiness 5f65dc87 Expose DB::DeleteRange and WriteBath::DeleteRange in Java 58b12dfe Set logs as getting flushed before releasing lock, race condition fix f8a4ea02 Move db_test and external_sst_file_test out of Travis's MAC OS run 534581a3 Fix a bug in tests in options operator= a2f7a514 Refactoring 2a5daa06 Add stderr log level for ldb backup commands 4561275c fix rate limiter test flakiness 7c80a6d7 Statistic for how often rate limiter is drained 0ad5af42 Clarify VerifyBackup behavior 6fb90134 sanitize readahead when direct read enabled f89b3893 Remove skip_table_builder_flush and default it to true cc253982 Use more default options in db_bench 8432bcf5 Make compaction_pri settable through option string d5b607a4 Make db_wal_test slightly faster ba4c77bd Divide external_sst_file_test e877afa0 Remove bulk loading and auto_roll_logger in rocksdb_lite 90d83550 Fix the wrong address for PREFETCH in DynamicBloom::Prefetch 08864df2 Move advanced column family options to advanced_options.h 2ca2059f Get unique_ptr to use delete[] for char[] in DumpMallocStats 253799c0 Add missing include for `abort()` c6d464a9 Fixed various memory leaks and Java 8 JNI Compatibility be3e5568 Fix unaligned reads in read cache 8ad0fcdf Separate small subset tests in DBTest 6c951c43 Run fewer tests in OSX f7997f13 add direct I/O to version notes 5.2.0 3b8ba703 Fix flaky DBTestUniversalCompaction.UniversalCompactionTrivialMoveTest2 96c7e150 Fix Java build e0b87afc Black list some slow valgrind tests e67232cf Handle failed Finish() in SST file writer 8efb5ffa [rocksdb][PR] Remove option min_partial_merge_operands and verify_checksums_in_comp… 1ba2804b Remove XFunc tests e7d902e6 add direct_io and compaction_readahead_size in db_stress 1ef5f50e detect logical sector size ed50308d check backup directory exists before listing children 4d7c06ce Make WriteBatchWithIndex moveble 5040414e Gracefully handle previous backup interrupted f206af56 add use_direct_io() to ReadaheadRandomAccessFile 08249344 truncate patch 286a36db posix writablefile truncate f0879e4c Page size isn't always 4k on linux 18eeb7b9 Fix interference between max_total_wal_size and db_write_buffer_size checks 1560b2f5 Temporarly return deprecated functions to fix MongoRocks build 2a0f3d0d level compaction expansion ebc8a799 alignment is on in ReadaheadRandomAccessFile::Read() 381fd322 Remove timeout_hint_us from WriteOptions fce7a6e1 Fail IngestExternalFile when bg_error_ exists a618a16f New subcode for IOError to detect the ESTALE errno 7ab00518 Remove deprecated DB::AddFile and DB::CompactRange 40166736 Adding Dlang to the list 756c5924 Allow adding external v1 sst file with no global seqno support aa0298fa Remove trailing whitespace from examples Makefile db2b4eb5 avoid direct io in rocksdb_lite 43e9f01c Fix repair_test on ROCKSDB_LITE 7106a994 Use monotonic time points in write_controller.cc and rate_limiter.cc c2247dc1 Make DBImpl::has_unpersisted_data_ atomic eb912a92 Remove disableDataSync option 0227c16d Update static library versions and add checksums b3aae4d0 Add repair_test to make check 421ce7c2 Add support for JNI Library on Linux on PowerPC. 9afa20cf Increase build version and HISTORY.md for releasing 5.2 a5adda06 Fix repair issues b48e4778 Consolidate file cutting logic in compaction loop ac2a77a7 Announce the experimetnal two-level index feature in HISTORY.md c4a37dcb Print the missed last layer in cfstats a12818af Blog post for 5.1.2 release 3b4ac807 Clarify ldb column family argument d70ce7ee Move db_bench flags out of unnamed namespace 186c7eed Remove incorrect statistics warning 53bb0151 [rocksdb][PR] compaction_style and compaction_pri should output their value as a st… 69d5262c Two-level Indexes 0a4cdde5 Windows thread 1aaa898c Adding GetApproximateMemTableStats method 9fc23c55 Use gcc-4.9-glibc-2.20-fb python in precommit_checker b797e421 Dump compression dictionary meta-block 036d668b Fix wrong result in data race case related to Get() 574b543f Rename merger.h -> merging_iterator.h add8b50c Move ThreadLocal implementation into .cc 71d2496a Fix arc setting for Facebook internal tools f289d9f4 Fix OSX build break after the fallocate change 4a3e7d32 Change the default of delayed slowdown value to 16MB/s 0513e21f RangeSync() should work with ROCKSDB_FALLOCATE_PRESENT not set 8b369ae5 Cleaner default options using C++11 in-class init ec79a7b5 Dedup code in option.cc and db_options.cc b96372de improving the C wrapper 04c4ec41 Change corruption_test to use 4 bits. 2d75cd40 NewLRUCache() to pick number of shard bits based on capacity if not given f25f1ec6 Add test DBTest2.GetRaceFlush which can expose a data race bug 37d4a79e Deserialize custom Statistics object in db_bench 3b35134e Avoid cache lookups for range deletion meta-block 94a0c32e Fix LRU Ref() for handles with external references only 17c11806 Generalize Env registration framework 07dddd5f EnvPosixTestWithParam should wait for all threads to finish 5dad9d6d Avoid logs_ operation out of DB mutex a7b13919 Fix CompactFiles() bug when used with CompactionFilter using SuperVersion 616a1464 Fix DeleteRange including sentinels in output files c918c4b7 Update USERS.md add user Pika 03ca2ac8 Remove function from DBImpl that are not used anywhere b0029bc7 Test merge op covered by range deletion in memtable d438e1ec Test range deletion block outlives table reader fba726e5 Version librocksdb.so 9da4d542 Range deletions unsupported in tailing iterator f2b4939d fixed typo 973f1b78 memtable: delete merge value for range deleteion aebfd170 fix non-portable behavior in encoder 753ff84a Fix get approx size d7ea44f2 Fixup a couple of builds errors on Linux. 537da370 c: allow set savepoint to writebatch af6ec4d7 fix batchresult handle leak e29bb934 Zlib 1.2.8 is no longer available, switched to 1.2.10 5ac97314 Fix std::out_of_range when DBOptions::keep_log_file_num is zero 4e35ffdf cmake: check -momit-leaf-frame-pointer before using it 3c0852d1 Make ingest external file backward compatible 0e8dfd60 Fix OptimizeForPointLookup() e840213d Change DB::GetApproximateSizes for more flexibility needed for MyRocks 9239103c Flush job should release reference current version if sync log failed da54d36a Disable IngestExternalFile in ReadOnly mode 5cf176ca Fix for 2PC causing WAL to grow too large 4a73bb0b Split travis jobs c70d3c7a Enable DBTest.GroupCommit as it runs in a reasonlable time now. 602c13a9 Remove fadvise with direct IO read f9d18e22 Fix DeleteRange file boundary correctness issue with max_compaction_bytes 3ce091fd Add KEEP_DB env var option 77b48066 Fix 2PC with concurrent memtable insert e8a09600 util/thread_local.h: silence a clang-build warning 324a0f98 Follow up for DirectIO refactor bc5d7b70 travis: For linux, do all tests under gcc 3e6899d1 change UseDirectIO() to use_direct_io() d4e07a84 fix warning of unused direct io helper functions dc2584ee direct reads refactor d18dd2c4 Abort compactions more reliably when closing DB 62384ebe Guarding extra fallocate call with TRAVIS because its not working pro… 9f246298 Performance: Iterate vector by reference fe395fb6 Allow incrementing refcount on cache handles 2172b660 Fix build on FreeBSD 3c233ca4 Fix Windows environment issues 76317345 Fix the error in ColumnFamiliesTest 7a02ad07 Update travis to ubuntu trusty 60c509ff Fix valgrind failure in test CurrentFileModifiedWhileCheckpointing2PC d0ba8ec8 Revert "PinnableSlice" 54d94e9c PinnableSlice e04480fa Fix MS warnings. Use ROCKSDB_Prsz for size_t. c081f721 5.0.1 release blog post ac73d755 Add GetSupportedCompressions() convenience function b104b878 Maintain position in range deletions map 640d7248 Update db_bench and sst_dump to test with block cache mid-point inser? 653ac1f9 C API: support total_order_mode 85ac1a32 Fix rocksdb::Status::getState 76711b6e Make ExternalSSTFileTest::CompactionDeadlock more deterministic c963460d Fix tests under GCC_481 33c86d67 Fix backupable db test e425ec11 utilities/backupable: backup should limit the copy size of wal. 0712d541 Delegate Cleanables d58ef52b Allow SstFileWriter to Fadvise the file away from page cache 17a4b75c Always fsync the file after file copying 2fb70dc7 examples: Add options_file_example to target all a738af8f db/pinned_iterators_manager.h: bugfix 906523d9 Add description to the 2PC checkpooint bug in HISTORY.md 438f22bc Fix bug of Checkpoint loses recent transactions with 2PC 335981d4 Fix the directory path for RocksDB repo 548b6280 Enable conditionally using adaptive mutexes 4e07b08e include/rocksdb/utilities/env_librados: fix typo ab48c165 Print cache options to info log 972f96b3 direct io write support 989e644e Remove sst_file_manager option from LITE 1beef656 Fix c_test 3d692822 persistent_cache: fix two timer 046099c9 The array is malloced by backtrace_symbols(), and must be freed 6ff2c8d7 Remove gflags as travis build dependency 3cd9ed1c Show sandcastle URL in phabricator 50e305de Collapse range deletions 5d1457db Dump persistent cache options 7bd725e9 db_bench: introduce --benchmark_read_rate_limit 29669184 Update Netflix section of USERS.md 342370f1 Simplify MemTable::Update 1a136c1f Expose file size fbff4628 Reduce compaction iterator status checks bd6cf7b5 WritableFileWriter: default buffer size equal min(64k,options.writabl? fc0c6fd9 "make format" format diff since last commit from master 816c1e30 gcc-7 requires include <functional> for std::function c2707358 Iterator should be in corrupted status if merge operator return false a8bf4d63 Make format shows wrong curl command for retrieving clang-format-diff.py 8f5d24ae C API: support get usage and pinned_usage for cache 0ab6fc16 Gcc-7 buffer size insufficient b7239bf7 Gcc 7 fallthrough 477b6ea5 std::remove_if requires <algorithm> 83f9a6fd Fail BackupEngine::Open upon meta-file read error a79eae4b Add pcache documentation images d71e728c Print user collected properties in sst_dump 7004a6f7 Add missing copyright header 3cdfaeca Fixes for MSVC compilation e097222e util/logging.cc: buffer of insufficient size (gcc-7 -Werror=format-length) cfc34d7c Missing break in case in DBTestBase::CurrentOptions bfbcec23 Gcc 7 error expansion to defined 6653e32a build: make it easier to pass PORTABLE 67adc937 intentional fallthough (prevents gcc-7/clang-4 error) 1a146f89 break Flush wait for dropped CF c3e5ee71 util/histogram.cc: HistogramStat::toString buffer insufficient 5334d8b4 table/block_based_table_builder.cc: intentional fallthrough - comment to match gcc pattern 36d42e65 Disable test to unblock travis build b57dd926 C API: support writebatch delete range 2ba59b5a Disallow ingesting files into dropped CFs 1f6f7e3e cast to signed char in ldb_cmd_test for ppc64le 243975d5 More accurate error status for BackupEngine::Open f0c509e2 Return finer-granularity status from Env::GetChildren* dc64f46b Add db_bench option for stderr logging 2cabdb8f Increase buffer size 4a17b47b Remove unnecessary header include 8c2b921f Fixed a crash in debug build in flush_job.cc 20ce081f Fix issue where IngestExternalFile insert blocks in block cache with g_seqno=0 5241e0db fix db_bench argument type c04f6a0b Specify shell in makefile 45c7ce13 CompactRangeOptions C API 2c2ba682 db_stress support for range deletions b821984d DeleteRange read path end-to-end tests 2f4fc539 Compaction::IsTrivialMove relaxing 1dce75b2 Update USERS.md 304b3c70 Update USERS.md fa50fffa Option to expand range tombstones in db_bench c26a4d8e Fix compile error in trasaction_lock_mgr.cc ed8fbdb5 Add EventListener::OnExternalFileIngested() event 2005c88a Implement non-exclusive locks 0b0f2357 Mention IngestExternalFile changes in HISTORY.md 23db48e8 Update HISTORY.md for 5.0 branch beb36d9c Fixed CompactionFilter::Decision::kRemoveAndSkipUntil 67f37cf1 Allow user to specify a CF for SST files generated by SstFileWriter 9053fe2a Made delete_obsolete_files_period_micros option dynamic edde954e fix clang build 56281f3a Add memtable_insert_with_hint_prefix_size option to db_bench 4a21b140 Cache heap::downheap() root comparison (optimize heap cmp call) e39d0808 Fix travis (compile for clang < 3.9) 3f407b06 Kill flashcache code in RocksDB b77007df Bug: paralle_group status updated in WriteThread::CompleteParallelWorker 247d0979 Support for range skips in compaction filter 96fcefbf c api: expose option for dynamic level size target 00197cff Add C API to set base_backgroud_compactions 5b219ecc deleterange end-to-end test improvements for lite/robustness aad11917 pass rocksdb oncall to mysql_mtr_filter otherwise tasks get created w… e3335289 DeleteRange write path end-to-end tests 7784980f Fix mis-reporting of compaction read bytes to the base level 3c6b49ed Fix implicit conversion between int64_t to int b3b87565 Remove unused assignment in db/db_iter.cc 4f6e89b1 Fix range deletion covering key in same SST file a2bf265a Avoid intentional overflow in GetL0ThresholdSpeedupCompaction 52fd1ff2 disable UBSAN for functions with intentional -ve shift / overflow 1886c435 Fix CompactionJob::Install division by zero 63c30de8 fix options_test ubsan 13e66a8f Fix compaction_job.cc division by zero 01eabf73 Fix double-counted deletion stat 7ffb10fc DeleteRange compaction statistics 236d4c67 Less linear search in DBIter::Seek() when keys are overwritten a lot cd7c4143 Improve Write Stalling System dfb6fe67 Unified InlineSkipList::Insert algorithm with hinting 3068870c Making persistent cache more resilient to filesystem failures 734e4aca Eliminate redundant cache lookup with range deletion 182b940e Add WriteOptions.no_slowdown 4118e133 Persistent Cache: Expose stats to user via public API f2a8f92a rocks_lua_compaction_filter: add unused attribute to a variable 4444256a Remove use of deprecated LZ4 function 548d7fb2 Fix fd leak when using direct IOs fd43ee09 Range deletion microoptimizations 23a18ca5 Reword support a little bit to more clear and concise 481856ac Update support to separate code issues with general questions a0deec96 Fix deadlock when calling getMergedHistogram fe349db5 Remove Arena in RangeDelAggregator e63350e7 Use more efficient hash map for deadlock detection a13bde39 Skip ldb test in Travis 73843aa6 Direct I/O Reads Handle the last sector correctly. 9d60151b Implement PositionedAppend for PosixWritableFile 3f622152 Lazily initialize RangeDelAggregator's map and pinning manager 41e77b83 cmake: s/STEQUAL/STREQUAL/ c1038d28 Release RocksDB 5.0 635a7bd1 refactor TableCache Get/NewIterator for single exit points f39452e8 Fix heap use after free ASAN/Valgrind a4eb7387 Allow plain table to store index on file with bloom filter disabled 36e4762c Remove Ticker::SEQUENCE_NUMBER 86eb2b9a Fix src.mk 0765babe Remove LATEST_BACKUP file 647eafdc Introduce Lua Extension: RocksLuaCompactionFilter 760ef68a fix deleterange asan issue 327085b7 fix valgrind 715591bb Ask travis to use JDK 7 972e3ff2 Enable allow_concurrent_memtable_write and enable_write_thread_adaptive_yield by default 420bdb42 option_change_migration_test: force full compaction when needed 1543d5d9 Report memory usage by memtable insert hints map. 018bb2eb DeleteRange support for db_bench dc51bd71 CMakeLists.txt: FreeBSD has jemalloc as default malloc 48e8baeb Decouple data iterator and range deletion iterator in TableCache 4b0aa3c4 Fix failed compaction_filter_example and add it into make all 53b693f5 ldb support for range delete 661e4c92 DeleteRange unsupported in non-block-based tables 489d1428 DeleteRange interface eba99c28 Fix min_write_buffer_number_to_merge = 0 bug 2ef92fea Remove all instances of relative_url until GitHub pages problem is fixed. 91300d01 Dynamic max_total_wal_size option ec2f6479 Consider subcompaction boundaries when updating file boundaries for range deletion 800e5155 Fix CSS issues again b952c898 Parallize persistent_cache_test and transaction_test 3b192f61 Handle full final subcompaction output file with range deletions 6c579520 Make range deletion inclusive-exclusive 425210cc CSS issues are arising on the Github Pages side. Temp fix. 1ea79a78 Optimize sequential insert into memtable - Part 1: Interface df5eeb85 Optimize sequential insert into memtable - Part 2: Implementation 5ed65085 Fix SstFileWriter destructor adb665e0 Allowed delayed_write_rate option to be dynamically set. 307a4e80 sst_dump support for range deletion 361010d4 Exporting compaction stats in the form of a map 672300f4 Use relative Urls for stylesheets b39b2ee1 do not call get() in recovery mode 1ca5f6d1 Fix 2PC Recovery SeqId Miscount e095d0cb Rocksdb contruns to new Sandcastle API 14c0380e Convenience option to parse an internal key on command line c90fef88 fix open failure with empty wal 4e20c5da Store internal keys in TombstoneMap a9fb346e Fix RocksDB Lite build failure in c_test.cc d133b08f Use correct sequence number when creating memtable 144cdb8f 16384 as e.g .value for compression_max_dict_bytes 9bd191d2 Fix deadlock between (WriterThread/Compaction/IngestExternalFile) a9fae0a9 CSS problems again :( 193221e0 Fix Forward Iterator Seek()/SeekToFirst() e48f3f8b remove tabs and duplicate #include in c api 85bd8f51 Minor fix to GFLAGS usage in persistent cache a7875272 c: support seek_for_prev 0f17f927 Make the header links a bit more flexible cf19f559 single quotes in feed 2dc019e0 Fix header links f1aedda0 More Jekyll 3.3 fixes c54cdc37 More Jekyll 3.3 updates 2bcaf824 Update product and feature template for Jekyll 3.3 24bceb09 Java API - Implement GetFromBatch and GetFromBatchAndDB in WBWI 815f54af Insert range deletion meta-block into block cache 9e7cf346 DeleteRange user iterator support 5c5d01ae Fix wrong comment (Maximum supported block size) f998c979 DeleteRange Get support 879f3663 Add C api for RateLimiter 557034f3 Remove all instances of baseurl 437942e4 Add avoid_flush_during_shutdown DB option 2b16d664 Change max_bytes_for_level_multiplier to double 16fb0443 expose IngestExternalFile to c abi ce22ea99 Fix casts for MSVC 196af035 Introduce FAIL_ON_WARNINGS CMake variable (default ON) 40a2e406 DeleteRange flush support d5555d95 Fix MSVC compile error in 32 bit compilation da61f348 Print compression and Fast CRC support info as Header level f9eb5679 db_bench: --dump_malloc_stats takes no effect 6a4faee5 fix freebsd build include path err and so & jar file name c90c48d3 Show More DB Stats in info logs 1b295ac8 DBTest.GetThreadStatus: Wait for test results for longer 25f5742f Update documentation to point at gcc 4.8 b50a81a2 Add a test for tailing_iterator 04751d53 L0 compression should follow options.compression_per_level if not empty 2946cadc Improve RangeDelAggregator documentation 0a9fd05c Update Vagrant file (test internal phabricator workflow) fcd1e0bf Make rocksdb work with internal repo 0aab5e55 FreeBSD: malloc_usable_size is in <malloc_np.h> (#1428) 9c0bb7f1 cmake: drop "-march=native" from CXX_FLAGS (#1429) eeb27e1b Add handy option to turn on direct I/O in db_bench (#1424) c6168d13 removed some declarations from c.h which resulted in undefined symbols (#1407) bc429de4 revert fractional cascading in farward iterator b9bc7a2a Use skiplist rep for range tombstone memtable 60a2bbba Makefile: generate util/build_version.cc from .in file (#1384) 9ee84067 Disable DBTest.RepeatedWritesToSameKey (#1420) f41df304 OptionChangeMigration() to support FIFO compaction 2e8004e6 Changing the legocastle run to use valgrind_test instead of _check 9de2f752 revert Prev() in MergingIterator to use previous code in non-prefix-seek mode 24495186 DBSSTTest.RateLimitedDelete: not to use real clock 1168cb81 Fix a bug that may cause a deleted row to appear again 99c052a3 Fix integer overflow in GetL0ThresholdSpeedupCompaction (#1378) f83cd64c Fix a bug that mistakenly disable regression_test.sh to update commit (#1415) 0e926b84 Passing DISABLE_JEMALLOC=1 to valgrind_check if run locally 4dfaa661 Make IsDeadlockDetect() virtual member of Transaction 59a7c033 Change ioptions to store user_comparator, fix bug 869ae5d7 Support IngestExternalFile (remove AddFile restrictions) 1d9dbef6 Restrict running condition of UniversalCompactionTrivialMoveTest2 4edd39fd Implement deadlock detection 48fd619a Minor fixes to RocksJava Native Library initialization (#1287) 48e4e842 Disable auto compactions in memory_test and re-enable the test (#1408) fb2e4129 column_family_test: disable some tests in LITE 5af651db fix data race in compact_files_test a0ba0aa8 Fix uninitialized variable gcc error for MyRocks b88f8e87 Support SST files with Global sequence numbers [reland] 08616b49 [db_bench] add filldeterministic (Universal+level compaction) 52c9808c not split file in compaciton on level 0 5e0d6b4c fix db_stress assertion failure ab539983 Bump RocksDB version to 4.13 (#1405) b4d07123 SamePrefixTest.InDomainTest to clear the test directory before testing aa09d033 Avoid calling GetDBOptions() inside GetFromBatchAndDB() 6fbe96ba Compaction Support for Range Deletion 257de78d Remove "-Xcheck:jni" from Java tests (#1402) d88dff4e add seeforprev in history 5027dd17 Fix a minor bug in the ldb tool that was not selecting the specified (#1399) fea6fdd6 Fix @see in two Java functions (#1396) b1031d6c Remove function local statics that interfere with memory pooling (#1392) f4705401 Handle WAL deletion when using avoid_flush_during_recovery e29d3b67 Make max_background_compactions and base_background_compactions dynamic changeable 21e8dace fix assertion failure in Prev() b9311aa6 Implement WinRandomRW file and improve code reuse (#1388) a249a0b7 check_format_compatible.sh to use some branch which allows to run with GCC 4.8 (#1393) 040328a3 Remove an assertion for single-delete in MergeHelper::MergeUntil 8cbe3e10 Relax the acceptable bias RateLimiterTest::Rate test be 25% f26a139d Log successful AddFile 5691a1d8 Fix compaction conflict with running compaction 017de666 fixup commit 1b7af5fb Redo handling of recycled logs in full purge 27bfe327 Editorial change to README.md 89cc404d A bit of doc restructuring 9e7fda82 Fix arcanist 2e4b5cab Add missing RateLimiter class to the Windows build (#1382) ce4963fd [doc] Document that Visual Studio 2015+ is now required for Windows builds (#1389) e4892709 Fix scoped arena iterator (#1387) f8d8cf53 Fix log_write_bench -bytes_per_sync option. (#1375) 02b3e398 Make txn->GetState() const 447f1712 new Prev() prefix support using SeekForPrev() 991b585e More block cache tickers d6ae6dec Add Statistics::getAndResetTickerCount(). aea3ce4c Avoid string CONCAT which is not supported in cmake 2.6 (#1383) 2ad68b97 Support running consistency checks in release mode 67501cfc Fix -ve std::string::resize 04b02dd1 Testing asset links after config change 8c55bb87 Make Lock Info test multiple column families d0623289 Revert "Support SST files with Global sequence numbers" 5cd28833 [RocksJava] Adjusted RateLimiter to 3.10.0 (#1368) 37737c3a Expose Transaction State Publicly 2c1f9529 Add facility to write only a portion of WriteBatch to WAL 043cb62d Fix record_size in log_write_bench, swap args to std::string::assign. (#1373) 4985f60f env_mirror: fix a few leaks (#1363) 5aded67d update of c.h (#1371) 912aec13 "Recent Posts" -> "All Posts" 7cbb298d Make sure that when contribtuing we call out creating appropriate directories a06ad471 Add top level doc information to CONTRIBUTING.md 3fdd5b97 A little more generic CONTRIBUTING.md ed4fc31d Add link to CONTRIBUTING.md to main docs README.md e4922e18 Forgot to truncate one blog post 6d8cd7ed Add CONTRIBUTING.md for rocksdb.org contribution guidance bd55e5a1 Fix some formatting of compaction blog post 0f60358b CRLF -> LF mod (including removing trailing whitespace for those files) b90e29c9 Truncate posts on the main /blog/ page 0d7acada Add author fields to blog posts 01be4418 Add GitHub link to the landing page header 9d6c9613 Fix Mac build ab01da54 Support SST files with Global sequence numbers d346ba24 Minor fixes around Windows 64 Java Artifacts (#1366) e91b4d0c Add factory method for creating persistent cache that is accessible from public be1f1092 Expose transaction id, lock state information and transaction wait information 6009c473 Store range tombstones in memtable 3c21c64c Use size hint for HashMap in multiGet. Similar to https://github.com/facebook/rocksdb/pull/1344 (#1367) 13f7a01f Fixing JNI release build for gcc (#975) 7260662b Add Java API for SstFileWriter 26388247 delete unused variable for PrevInterval() 87dfc1d2 Fix conflict between AddFile() and CompactRange() eb44ed65 Update 2016-09-28-rocksdb-4-11-2-released.markdown e4437610 Update 2016-09-28-rocksdb-4-11-2-released.markdown 501f0510 Update 2016-09-28-rocksdb-4-11-2-released.markdown dec9009f Update 2016-09-28-rocksdb-4-11-2-released.markdown 4ed69dd0 Create 2016-09-28-rocksdb-4-11-2-released.markdown 21f4bb5a cmake support for linux and osx (#1358) 4defe306 fix typo in comments (#1360) f517d9dd Add SeekForPrev() to Iterator eb3894cf Recompute compaction score on SetOptions (#1346) 5c64fb67 Fix AddFile() conflict with compaction output [WaitForAddFile()] 9e9f5a0b Fix CompactFilesTest.ObsoleteFiles timeout (#1353) c2a62a4c not cut compaction output when compact to level 0 9ed928e7 Split DBOptions into ImmutableDBOptions and MutableDBOptions 4bc8c88e Recover same sequence id from WAL (#1350) 0a1bd9c5 add cfh deletion started listener da5a9a65 Fix mac build d45eb6c6 Fix typo (#1349) abc0ae46 Add AddFile() InternalStats for Total files/L0 files/total keys ingested 71525633 forbid merge during recovery 5735b3dc Fix compiling under -Werror=missing-field-initializers 654ed9a2 loose the assertion condition of rate_limiter_test e4d3f5d9 Fix DBImpl::GetWalPreallocateBlockSize Mac build error 7afbb742 solve the problem of table_factory_to_write_=nullptr (#1342) d78a4401 DBImpl::GetWalPreallocateBlockSize() should return size_t 42ac9c5f Retry getting arcanist token on failure b666f854 Consider more factors when determining preallocation size of WAL files 4c3f4496 Add TableBuilderOptions::level and relevant changes (#1335) 3edb9461 Avoid hard-coded sleep in EnvPosixTestWithParam.TwoPools 0a88f38b Remove ColumnFamilyData::options() 41a9070f Fix java makefile dependencies 8d9bf5c4 Fix DBOptionsTest.GetLatestOptions 40cfa3e0 Fix DBWALTest.RecoveryWithLogDataForSomeCFs with mac 06b4785f Fix recovery for WALs without data for all CFs d7242ff4 Fix GetSortedWalFiles when log recycling enabled 17f76fc5 DB::GetOptions() reflect dynamic changed options 215d1282 Fix typo (#903) a958c264 Rename jvalue to jval in rocksjni 0a165bd7 Have Facebook link point to RocksDB on FB 3639f328 Fix bug in UnScSigned-off-by: xh931076284 <931076284@qq.com> (#1336) 8e061f97 Refactor GetMutableOptionsFromStrings 81747f1b Refactor MutableCFOptions ba65c816 Support POSIX RandomRWFile 1d980a8e Create CNAME 2adab1dd Add API links to the header bar a182b298 Preserve blog comments in markdown f54de923 Adding Dgraph to list of Users (#1291) 9e4aa798 Summary: (#1313) a10e8a05 Fix C api memtable rep bugs. (#1328) eb1d4d53 Release RocksDB 4.12 22d88e24 Allow an offset as well as a length to be specified for byte[] operations in RocksJava JNI (#1264) b06b1913 add C api for set wal_recovery_mode (#1327) 1cca0912 Temporarily revert Prev() prefix support de28a255 Update HISTORY.md for thread-local stats 0fcb6dbe Remove extraneous function prototypes from c.h (#1326) 52ee07b0 Move AddFile() tests to external_sst_file_test.cc 66a91e26 Add NoSpace subcode to IOError (#1320) 67036c04 Fix Flaky ColumnFamilyTest.FlushCloseWALFiles 0e2da497 fix typo in option.h's comment (#1321) 6d61358a Add real Google Analytics ID 2d9d36ea Have "Edit on GitHub" point to master instead of gh-pages 93775189 Update landing page content 1ec75ee7 Add redirects from old blog posts link to new format 607628d3 Support ZSTD with finalized format ce1be2ce Fix build error on Windows (AppVeyor) (#1315) f7669b40 Fix Windows Build 22696b08 Fix uninitlized CompactionJob::SubcompactionState::current_output_file_size c1865e0f Trigger more tests per diff a88677d2 Remove ImmutableCFOptions from public API 80c75593 Fix data race in AddFile() with multiple files + custom comparator bug 5051755e Fix db_bench memory use after free (detected by clang_analyze) 4fd08f4b Ensure Correct Behavior of StatsLevel kExceptDetailedTimers and kExceptTimeForMutex (#1308) e14fbaae Add FAQ based on the front page of the current rocksdb.org 3c226240 Migrate the RocksDB Worpdress blog over to Jekyll ee0e2201 Transfer the current Getting Started contents to GitHub Pages 5a0e9a4c Initial Landing Page 9447a854 Remove the `doc` directory 32149059 Merge options source_compaction_factor, max_grandparent_overlap_bytes and expanded_compaction_factor into max_compaction_bytes 4590b53a add stats to Cache::LookUp() 85bb3082 Expose Utility function StringToMap() (#1306) 8ce1b844 Fix Travis on Mac 380e651a Fix Mac build failure (#1309) 1613fa94 Thread-specific histogram statistics 6a14d55b add prefix_seek_mode to db_iter_test de47e2bd Fix ClockCache memory leak f099af4c Fix travis db74b1a2 fix bug in merge_iterator when data race happens b18f9c9e add nullptr check to internal_prefix_transform 4e395e87 Update docs README.md 2482d5fb support Prev() in prefix seek mode 7541c7a7 Fix cache_test valgrind_check failure c8513cde Update the download location of Snappy (#1304) b49b92cf Introduce Read amplification bitmap (read amp statistics) c7004840 store prefix_extractor_name in table 4ad928e1 add comment to SimCache to estimate actual capacity e9b2af87 Expose ThreadPool under include/rocksdb/threadpool.h 23a05700 Document memtable flush behavior in CancelAllBackgroundWork() dade61ac Mitigate regression bug of options.max_successive_merges hit during DB Recovery cce702a6 [db_bench] Support single benchmark arguments (Repeat for X times, Warm up for X times), Support CombinedStats (AVG / MEDIAN) 3586901f cat tests logs sorted by exit code b2ce5953 Persist data during user initiated shutdown 4b3438d2 Fix parallel valgrind (valgrind_check) a081f798 Relax consistency for thread-local ticker stats b10d65c2 Update and slightly clarify instructions in build_detect_platform (#1301) f85f99bf Fix the Windows build of RocksDB Java. Similar to https://github.com/facebook/rocksdb/issues/1220 (#1284) 7b810951 Fix a crash when compaction fails to open a file 7c958683 Thread-specific ticker statistics ea9e0757 Add initial GitHub pages infra for RocksDB documentation move and update. (#1294) 2a9c9710 [Flaky Test] Disable DBPropertiesTest.GetProperty d76ddf32 Disable ClockCache db_crashtest cec2c643 fix data race in NewIndexIterator() in block_based_table_reader.cc badbff65 Not insert into block cache if cache is full and not holding handle 4a16c32e Option to cache index/filter blocks with priority 99c4af71 Make ClockCache available with TSAN build f57bc1d0 Fix lambda expression for clang/windows 5440675c Fix lambda capture expression for windows 6584cec8 Fold function for thread-local data 817eeb29 Add singleDelete to RocksJava (#1275) ffdf6eee Add Status to RocksDBException so that meaningful function result Status from the C++ API isn't lost (#1273) ecf90038 Fix bug in printing values for block-based table 72f8cc70 LRU cache mid-point insertion 6a17b07c Add TablePropertiesCollector support in SstFileWriter 78837f5d TableBuilder / TableReader support for range deletion 4cc37f59 Introduce ClockCache ff17a2ab Adding TBB as dependency. 49d88be0 c abi: allow compaction filter ignore snapshot (#1268) 0b63f51f fixes 1215: execute_process(COMMAND mkdir ${DIR}) fails to create a directory with cmake on Windows (#1219) 3981345b Small nits (#1280) 2a2ebb6f Move LRUCache structs to lru_cache.h header 2fc2fd92 Single Delete Mismatch and Fallthrough statistics 3771e379 WriteBatch support for range deletion 236756f2 Make SyncPoint return immediately when disabled 64a0082c Fix DBSSTest::AddExternalSstFileSkipSnapshot valgrind fail dd7a748c Fix java build 4fe12baa Make db_bench less space for --stats_per_interval 6525ce4c Compaction stats printing: "batch" => "commit group" a117891b Fixed typo (#1279) b248e98c Fix a destruction order issue in ThreadStatusUpdater deda159b Added min/max/avg data block size output to sst_dump e408e98c add Name() to Cache a297643f Fix valgrind memory leak d11c09d9 Eliminate memcpy from ForwardIterator d3675550 Added further Java API options for controlling concurrent writes ebdfe34c Exposed further Java API options for controlling compaction d1be5946 Improve documentation of SliceTransform. 6056d631 Improve comment and bug fix for GetOptionsFromMap functions in convenience.h 76a67cf7 support stackableDB as the baseDB of transactionDB 67c1ae88 Travis build break fix b693ba68 Minor PinnedIteratorsManager Refactoring db3dfb16 Fixes for arcanist config (#1271) 87c91bd8 Persistent Read Cache (8) Benchmark tooling 2914de64 add sim_cache stats to Statistics 8b79422b [Proof-Of-Concept] RocksDB Blob Storage with a blob log file. 4beffe00 Fix test data race in two FaultInjectionTest tests 821bcb0b util/arena.cc: FreeBSD: More portable use of mmap(MAP_ANON) (#1254) 5370f44a Increase RocksDB version 56dd0341 read_options.background_purge_on_iterator_cleanup to cover forward iterator and log file closing too. ccecf3f4 UniversalCompaction should ignore sorted runs being compacted (when compacting for file num) 1b0069ce Remove non-gtest from parallelized tests 638c49f2 Change HISTORY.md for release 4.11 6b8e9c68 fix vs generator (#1269) c38b075e Update HISTORY.md 8f399e3f Update HISTORY.md 98d0b78e Added check_snapshot option in the DB's AddFile function (#1261) 9fd68b7f set travis open file descriptor limit 59ddb505 Fix travis build break f4d98636 Added SetOptions support to RocksJava (#1243) 7882cb97 Make DBOptionsTest::EnableAutoCompactionAndTriggerStall less falky 44f5cc…
* Squashed 'rocksdb-sys/rocksdb/' changes from 98084910..6f35cb93 6f35cb93 bump version c1565071 update history dd0efa4e Preserve overlapping file endpoint invariant aead4041 fix HISTORY.md typo a0cdc3ce Bump version to 5.8.7 7513f635 Fix IOError on WAL write doesn't propagate to write group follower 9e47084c Bump version to 5.8.6 36074ba5 Enable cacheline_aligned_alloc() to allocate from jemalloc if enabled. aa00523e Add -DPORTABLE=1 to MSVC CI build cf2b9823 Bump version to 5.8.5 e8c9350f Blob DB: not using PinnableSlice move assignment 4907d246 Bump version to 5.8.4 5d928c79 Blob DB: Fix race condition between flush and write 725bb9d6 Blob DB: Fix release build b7367fe8 Bump version to 5.8.3 13b2a9b6 Blob DB: use compression in file header instead of global options 5dc70a15 Fix PinnableSlice move assignment 9019e912 dynamically change current memtable size 7f1815c3 Bump version to 5.8.2 2584a18e Blob DB: Fix BlobDBTest::SnapshotAndGarbageCollection asan failure 17f67b54 PinnableSlice move assignment 6fb56c58 Blob DB: Add compaction filter to remove expired blob index entries f90ced92 Blob DB: fix snapshot handling 632f36dc Blob DB: option to enable garbage collection 11bacd57 Blob DB: Fix flaky BlobDBTest::GCExpiredKeyWhileOverwriting test f98efcb1 Blob DB: Evict oldest blob file when close to blob db size limit c1e99edd Blob DB: cleanup unused options ffc3c62c Blob DB: Initialize all fields in Blob Header, Footer and Record structs 9e825409 Blob DB: update blob file format d66bb21e Blob DB: Inline small values in base DB 05d5c575 Return write error on reaching blob dir size limit 2b8893b9 Blob DB: Store blob index as kTypeBlobIndex in base db 419b93c5 Blob DB: not writing sequence number as blob record footer 8afb0036 fix lite build dded348d Blob DB: Move BlobFile definition to a separate file 37473612 add GetLiveFiles and GetLiveFilesMetaData for BlobDB 8cff6e94 Enable WAL for blob index c2934729 Add ValueType::kTypeBlobIndex eae53de3 Make it explicit blob db doesn't support CF 65aec19d Fix memory leak on blob db open 30b38c98 TableProperty::oldest_key_time defaults to 0 2879f4be Bump version to 5.8.1 88595c88 Add DB::Properties::kEstimateOldestKeyTime 266ac245 Bumping version to 5.8 64185c23 update HISTORY.md for DeleteRange bug fix e83d6a02 Not using aligned_alloc with gcc4 + asan 0980dc6c Fix wrong smallest key of delete range tombstones b7679723 avoid use-after-move error c4174427 CMake: Fix formatting c21ea8f7 CMake: Add support for CMake packages 54443455 add Erlang to the list of language bindings 2972a702 Minor updates to FlushWAL blog fbfa3e7a WriteAtPrepare: Efficient read from snapshot list b01f426f Blog post for FlushWAL 503db684 make blob file close synchronous 3c840d1a Allow DB reopen with reduced options.num_levels 92bfd6c5 Fix DropColumnFamily data race 7fdf735d Pinnableslice examples and blog post 7fbb9ecc support disabling checksum in block-based table 19cc66dc fix clang bug in block-based table reader 7eba54eb test compaction input-level split range tombstone assumption cd26af34 Add unit test for WritePrepared skeleton a1247981 Improved transactions support in C API c10b3913 LANGUAGE-BINDINGS.md: add another rust binding 90177432 Remove leftover references to phutil_module_cache 234f33a3 allow nullptr Slice only as sentinel ccf7f833 Use PinnableSlice in Transactions 1dfcdb15 Extend pin_l0 to filter partitions 39ef9005 stop calling memcmp with nullptrs 78cb6b61 Provide byte[] version of SstFileWriter.merge to reduce GC Stall 867fe92e Scale histogram bucket size by constant factor f004307e CMake improvements 09ac6206 Circumvent ASAN false positive 5b68b114 Blob db create a snapshot before every read 4624ae52 GC the oldest file when out of space 8ace1f79 add counter for deletion dropping optimization 0d8e992b Revert the mistake in version update 5358a805 add VerifyChecksum to HISTORY.md ed0a4c93 perf_context measure user bytes read 1efc600d Preload l0 index partitions bddd5d36 Added mechanism to track deadlock chain c1384a70 fix db_stress uint64_t to int32 cast 29877ec7 Fix blob db crash during calculating write amp 8f2598ac Enable Cassandra merge operator to be called with a single merge operand 9a44b4c3 Allow merge operator to be called even with a single operand ac8fb77a fix some misspellings 23593171 minor improvements to db_stress af012c0f fix deleterange with memtable prefix bloom 1c8dbe2a update scores after picking universal compaction eb642530 Update WritePrepared with the pseudo code 132306fb Remove PartialMerge implementation from Cassandra merge operator 71598cdc Fix false removal of tombstone issue in FIFO and kCompactionStyleNone 3204a4f6 Fix missing stdlib include required for abort() 7aa96db7 db_stress rolling active window dfa6c23c Update RocksDBCommonHelper to use escapeshellarg e367774d Overload new[] to properly align LRUCacheShard ad42d2fc Remove residual arcanist_util directory 279296f4 properly set C[XX]FLAGS during CMake configure-time checks c5f0c6cc compile with correct flags to determine SSE4.2 support 185ade4c cmake: support more compression type 5449c099 rocksdb: make buildable on aarch64 a144a978 Fix for CMakeLists.txt on Windows for RocksJava acf935e4 fix deletion dropping in intra-L0 8254e9b5 make sst_dump compression size command consistent 74f18c13 db_bench support for non-uniform column family ops 5de98f2d approximate histogram stats to save cpu 3f588843 Fix c_test ASAN failure e5a1b727 Fix blob DB transaction usage while GC 6f051e0c fix corruption_test valgrind ac098a46 expose set_skip_stats_update_on_db_open to C bindings 666a005f Support prefetch last 512KB with direct I/O in block based file reader ad77ee0e Revert "Makefile: correct faligned-new test" b87ee6f7 Use more keys per lock in daily TSAN crash test 25df2425 Add column families related functions (C API) 64f84843 block_cache_tier: fix gcc-7 warnings 0cecf815 Write batch for `TransactionDB` in C API 6a9de434 Windows.h macro call fix 23c7d135 fix comment 1fbad84b Makefile: correct faligned-new test 7848f0b2 add VerifyChecksum() to db.h 47ed3bfc fix WinEnv assertions d97a72d6 Try to repair db with wal_dir option, avoid leak some WAL files 36375de7 gcc-7/i386: markup intentional fallthroughs bdc056f8 Refactor PessimisticTransaction a9a4e89c Fix valgrind complaint about initialization 4ca11b4b Update USERS.md c9804e00 Refactor TransactionDBImpl 20dc5e74 Optimize range-delete aggregator call in merge helper. 0d4a2b73 Avoid blob db call Sync() while writing 627c9f1a Don't add -ljemalloc when DISABLE_JEMALLOC is set dce6d5a8 db_bench background work thread pool size arguments 4f81ab38 Makefile: fix for GCC 7+ and clang 4+ 92afe830 Update all blob db TTL and timestamps to uint64_t 5883a1ae Fix /bin/bash shebangs cc01985d Introduce bottom-pri thread pool for large universal compactions 0b814ba9 Allow concurrent writes to blob db 2c45ada4 Blob DB garbage collection should keep keys with newer version 58410aee Fix the overflow bug in AwaitState c3d5c4d3 Refactor TransactionImpl 060ccd4f support multiple CFs with OPTIONS file 34538706 Fix statistics in RocksJava sample 1900771b Dump Blob DB options to info log 3218edc5 Fix universal compaction bug 6a36b3a7 fix db get/write stats a84cee81 Add a missing "once" in .h 21696ba5 Replace dynamic_cast<> e85f2c64 Prevent empty memtables from using a lot of memory ac748c57 Fix FIFO Compaction with TTL tests aaf42fe7 Move blob_db/ttl_extractor.h into blob_db/blob_db.h aace4651 Fix license headers in Cassandra related files 50a96913 CacheActivityLogger, component to log cache activity into a file 6083bc79 Blob DB TTL extractor 710411ae fix asan/valgrind for TableCache cleanup 3a3fb00b TARGETS file not setting sse explicitly fca4d6da Build fewer tests in Travis platform_dependent tests 8f553d3c remove unnecessary internal_comparator param in newIterator 7f6d012d "ccache -C" in Travis d12691b8 move TableCache::EraseHandle outside of db mutex f33f1136 fix db_bench argument type e7697b8c Fix LITE unit tests 3ce20e98 Fix use of RocksDBCommonHelper in cont_integration.sh c281b448 Revert "CRC32 Power Optimization Changes" 9980de26 Fix FIFO compaction picker test 2289d381 CRC32 Power Optimization Changes 30b58cf7 Remove the orphan assert on !need_log_sync fe1a5559 Fix flaky write_callback_test addbd279 5.6.1 release blog post 30edff30 buckification: remove explicit `-msse*` compiler flags 2b259c9d Lower num of iterations in DeadlockCycle test 277f6f23 Release note for partitioned index/filters 5e731a13 Remove unused rocksdb arcanist lib 9b11d434 Fix broken links 06f19174 add vcpkg as an windows option ea8ad4f6 Fix compaction div by zero logging 34112aef Added db paths to c 1d8aa296 Gcc 7 ParsedInternalKey replace memset with clear function. a4c42e80 Fix UBSAN issue of passing nullptr to memcmp 16e03882 LRUCacheShard cache line size alignment 216644c6 enable UBSAN macro in TARGETS e67b35c0 Add Iterator::Refresh() a34b2e38 Fix caching of compaction picker's next index 72502cf2 Revert "comment out unused parameters" 1d7048c5 comment out unused parameters 534c255c Cassandra compaction filter for purge expired columns and rows 63163a8c Remove make_new_version.sh 0302da47 Reduce blob db noisy logging 3e5ea29a Fix Flaky DeleteSchedulerTest::ImmediateDeleteOn25PercDBSize a22b9cc6 overlapping endpoint fixes in level compaction picker ffd2a2ee delete ExpandInputsToCleanCut failure log 3e6e863b Remove arcanist_util directory 36651d14 Moving static AdaptationContext to outside function 6e3ee015 Update java/rocksjni.pom ecff9d5e Include write_buffer_manager in ImmutableDBOptions::Dump ae28634e Remove some left-over BSD headers 33b1de82 Remove format compatibility hack 2f375154 checkout local branch in check_format_compatible.sh ddb22ac5 avoid collision with master branch in check format 0c03a7f1 set the remote for git checkout 7ac184c6 Revert cmake -DNDEBUG for non-MSVC 0655b585 enable PinnableSlice for RowCache 00464a31 Fix column_family_test with LITE build b2dd192f tools/write_stress.cc: Correct "1204" typos. cbaab304 table/block.h: change memset f1a056e0 CodeMod: Prefer ADD_FAILURE() over EXPECT_TRUE(false), et cetera 4a2e4891 Add back the LevelDB license file a7321fc9 Remove the licensing description in CONTRIBUTING.md 3c327ac2 Change RocksDB License 13201336 Make TARGETS file portable ccf5f08f Set CACHE_LINE_SIZE for s390, PPC, ARM64 67510eef db_crashtest.py: remove need for shell 4267eb00 Remove punit tests 5bfb67d9 Enable write rate limit for updaterandom benchmark 20a691d9 Update HISTORY to release 5.7 98d1a551 db_bench to by default verify checksum 26ce69b1 Update blob db to use ROCKS_LOG_* macro 43e4eef7 remove unnecessary fadvise 21b17d76 Fix BlobDB::Get which only get out the value offset 70440f7a Add virtual func IsDeleteRangeSupported 7550255c Add JAVAC_ARGS as Makefile variable 7a0b5de7 Gcc 7 ignored quantifiers 000bf0af Improve the design and native object management of Stats in RocksJava 269d383d Bump version to 5.7 c32f2722 Fixes db_bench with blob db fcd99d27 db_bench_tool: fix buffer size 87128bd5 fix regression test 8f927e5f Fix undefined behavior in Hash 643b787c Added a note about LZ4 compression dependency 56656e12 Temporarily disable FIFOCompactionWithTTLTest b5fb85ec fix valgrind init complaint 657df29e Add max_background_jobs to db_bench a43c053a remove duplicated utilities/merge_operators/cassandra/test_utils.cc in src.mk 7c4a9e6c Initialize a variable in ldb to make code analysis tool happy 98669b53 init filters_in_partition_ 0013bf14 fix asan and valgrind leak report in test 521b4c28 rocksdb 5.5.1 release post 33042573 Fix GetCurrentTime() initialization for valgrind f6b9d935 Fix clang error in PartitionedFilterBlockBuilder 45b9bb03 Cut filter partition based on metadata_block_size f4ae1bab update history for OnBackgroundError and DeleteRange fix 1cb8c6de Add -enable_pipelined_write to db_bench and add two defaults 7604b463 Update the AddDBStats in LITE 1e34d07e Simplify and document sync rules for logs_ etc d310e0f3 Regression test for empty dedicated range deletion file e9f91a51 Add a fetch_add variation to AddDBStats c1b375e9 skip generating empty sst 67b417d6 fix format compatible test afbef651 Bug fix: Fast CRC Support printing is not honest 397ab111 Improve Status message for block checksum mismatches 18c63af6 Make "make analyze" happy 01534db2 Fix the reported asan issues 1cd45cd1 FIFO Compaction with TTL 982cec22 Fix TARGETS file tests list b49b3710 allow numa >= 2.0.8 e517bfa2 CLANG Tidy dc3d2e4d update compatible test 89468c01 Fix Windows build broken by 5c97a7c0664d4071768113814e9ba71fe87e18cf 51778612 Encryption at rest support 7061912c Trivial typo in HISTORY.md 2a9cd879 Fix jni WriteBatchThreadedTest 0025a364 revert perf_context and io_stats to __thread 5c97a7c0 Unit Tests for sync, range sync and file close failures 4cee11f4 Intra-L0 blog post 857e9960 Improve the error message for I/O related errors. d757355c Fix bug that flush doesn't respond to fsync result 8e6345d2 Update rename of ParanoidCheck 499ebb3a Optimize for serial commits in 2PC 0ac4afb9 Sanitize partitioning options 521724ba fixed wrong type for "allow_compaction" parameter 71f5bcb7 Introduce OnBackgroundError callback 88cd2d96 Downgrade option sanitiy check level for prefix_extractor 6837a176 Fix Data Race Between CreateColumnFamily() and GetAggregatedIntProperty() af174675 WriteBufferManager will not trigger flush if much data is already being flushed 9467eb61 Fix flush assertion with tsan 048446fc Fix cassandra ASAN use-after-free a21db161 Implement ReopenWritibaleFile on Windows and other fixes c430d69e fix coredump for release nullptr 0d278456 default implementation for InRange cbd825de Create a MergeOperator for Cassandra Row Value 2c98b06b Remove pin_slice option by making it the default c80c6115 add db_bench options for partitioning 6a3377f4 Synchronize statistic enumeration values between statistics.h and java API 53dda879 Do not run RateLimiterTest.Rate test on Travis+Mac OSX. ae8571f5 Fix blob db compression bug 7a380def Update blob_db_test 89ad9f3a Allow ignoring unknown options when loading options from a file 6b5a5dc5 fixed typo 0f228be3 fixed typo in util/dynamic_bloom.h c217e0b9 Call RateLimiter for compaction reads 91e2aa3c write exact sequence number for each put in write batch 6f4154d6 record index partition properties 5d5a28a9 Fix Clang release build broken by 5582123dee8426a5191dfd5e846cea8c676c793c 0175d58c Make direct I/O write use incremental buffer 7a270069 GNU C library for struct tm has 2 additional fields. d713471d Limit trash directory to be 25% of total DB 9bb91e93 Dedup release 27b45016 Update HistogramTypes in the Java API e97304c6 update history for 5.6 5582123d Sample number of reads per SST file db818d2d Fix RocksDB Lite build with CLANG a472c4ae update 5.5 change log bc09c8a0 Fix crash in PosixWritableFile::Close() when fstat() fails 6d0f22e4 Fix mock_env.cc uninitialized variable c2012d48 Java APIs for put, merge and delete in file ingestion 85dace2a Disable DBRangeDelTest::TailingIteratorRangeTombstoneUnsupported for ubsan d4f7731b fix travis error with init time in mockenv 550a1df7 Fix clang errors by asserting the precondition cc5f9339 Fix concurrency issue with filter_block_set_ 2e64f450 bump version to 5.6 afbc2d0d Force travis to build with clang on MacOS b172a3f1 Fix warnings while generating RocksJava documentation 52a7f38b WriteOptions.low_pri which can throttle low pri writes if needed 26a8a807 Switch from CentOS 5 to CentOS 6 for crossbuilding RocksJava dba9f372 Fix db_write_test clang/windows build failure c7662a44 fixed typo 7e8d95cc Fix the Java build which was broken by a4d9c02 7e5fac2c remove test dir before exit when current regression is running 7f6c02dd using ThreadLocalPtr to hide ROCKSDB_SUPPORT_THREAD_LOCAL from public… 138b87ea Fix interaction between CompactionFilter::Decision::kRemoveAndSkipUnt… 95b0e89b Improve write buffer manager (and allow the size to be tracked in block cache) a4d9c025 Pass CF ID to MemTableRepFactory f68d88be Fix DBWriteTest::ReturnSequenceNumberMultiThreaded data race 215076ef Fix TSAN: avoid arena mode with range deletions 3a8a848a account for L0 size in estimated compaction bytes 0fae3f5d codemod: format TARGETS with buildifier [5/5] (D5092623) 87219960 add checkpoint support for single db in regression test 5a9b4d74 Retire memenv https://github.com/facebook/rocksdb/pull/2082 d6019651 sync internal/external TARGETS bbaba51b Add missing index type to C-API 292edfd5 travis: test with xcode8.3 (OS X 10.12) 0dc3040d db: avoid `#include`ing malloc and jemalloc simultaneously 9b3ed835 fix regression test 9c9909bf Support ingest file when range deletions exist ad19eb86 Fixing blob db sequence number handling 51ac91f5 Histogram of number of merge operands 345878a7 update blob_db_test cbc821c2 change regression rebuild to one level 103d0692 Avoid unsupported attributes when not building with UBSAN 5fd04566 travis: reduce the number of travis builders 2d05002b RocksDB 5.4.5 release blog post 7eca90f1 Update RocksDB blog authors d03c3449 update comment of GetNextFile f7bb1a00 support merge and delete in file ingestion c2c62ad4 Reorder variables of ReadOptions 7bb1f5d4 Increase of compaction threads should be logged at info level instead of a warning 6c456eca Clean zstd files 347e16f8 codemod: replace `headers = AutoHeaders.*` with `auto_headers` 0be636bf Fix db_bench build break with blob db 135ee6a3 fix tsan crash data race a99fb992 fix column_family_test asan f41bffb3 travis: clang-3.6 -> clang-4.0 e7612798 update buckifer/TARGETS bb01c188 Introduce max_background_jobs mutable option 5a253046 Fix the CMakeLists for RocksJava 41cbb727 options.delayed_write_rate use the rate of rate_limiter by default. 50680346 range sync should be enabled 02594b5f Fix build errors in blob_dump_tool with GCC 4.8 52d9e5f7 Fix column family seconds_up accounting 7d8207f1 Fix errors in clang-analyzer builds 85b8569a Fix release build on Linux 69ec8356 Allow SstFileWriter to use the rate limiter 6cc9aef1 New API for background work in single thread pool 9d0a07ed Fix rocksdb.estimate-num-keys DB property underflow 578fb0b1 Simple blob file dumper ac39d6be Core-local statistics 3e86c0f0 disable direct reads for log and manifest and add direct io to tests 15ba4d6c Address MS Visual Studio 2017 issue with autovector 88c818e4 Replace deprecated RocksDB#addFile with RocksDB#ingestExternalFile 228f49d2 Fix data races caught by tsan 4c9d2b10 remove #include port/port.h in public header file 07bdcb91 New WriteImpl to pipeline WAL/memtable write d746aead Suppress clang-analyzer false positive 217b866f column_family_test: EnvCounter::num_new_writable_file_ to be atomic 9f839a7f keep util/build_version.cc when make clean 7eecd40a add emacs tags file - etags 9bbba4fe Remoe unused BlockBasedTable::compaction_optimized_ f5ba131b Fixed some spelling mistakes 146b7718 Fix mingw compilation with -DNDEBUG a36220cc fix unity test 0ebdd705 fixed typo 8032f4cb Remove -pie in TSAN 362ba9b0 Release RocksDB 5.5.0 ba685a47 Support ingest_behind for IngestExternalFile 01ab7b52 Add ROCKSDB_LIBRARY_API macro to a few C APIs, to fix windows build cb9392a0 add Transactions and Checkpoint to C API 445f1235 s/std::snprintf/snprintf cd593c28 Fix travis java_test f720796e fixed typo a48a62d5 define NDEBUG in CMake non-debug builds 1ca723db C API: support pinnable get 2ef15b85 Core-local stats blog post 4f9e69cc fix log err 11c5d474 cross-platform compatibility improvements d0043330 Put lib files into suitable path in RPM package 86d54925 Fix build error with blob DB. 254c4680 Fix the RocksJava Release on Windows 7a47b431 Fix .gitignore pattern fa5a15ce Make sure that zstd is statically linked correctly in the Java static build 3fa9a39c Add GetAllKeyVersions API 1a60982a Simplified instructions for CentOS a5cc7ece Facility for cross-building RocksJava using Docker ccd3dddf Blog post for partitioned index/filters b145c34d Update blog authors bbe9ee7d core-local array type conversions c2be4343 Build and link with ZStd when creating the static RocksJava build c61e72c4 Add missing files of blob_db to CMake file 3907c94f Fix ColumnFamilyTest:BulkAddDrop cda5fde2 CoreLocalArray class 93949667 update TARGETS 4e83b800 title: Bulkoading -> title: Bulkloading d85ff495 Blob storage pr 492fc49a fix readampbitmap tests be421b0b portable sched_getcpu calls 0f559abd Add NO_UPDATE_BUILD_VERSION option to makefile 3a04a254 Flink state 35df23fe Fix suite exclisions e7cea86f Fixes the CentOS 5 cross-building of RocksJava 259a00ea unbiase readamp bitmap a6209669 port: updated PhysicalCoreID() df035b68 Print compaction_options_universal.stop_style in LOG file 4897eb25 dont skip IO for filter blocks 3f73d54b Add C API to set max_file_opening_threads option 0b69e507 Define CACHE_LINE_SIZE only when it's not defined 2cd00773 Add bulk create/drop column family API 40af2381 Object lifetime in cache fdaefa03 travis: add Windows cross-compilation a30a6960 do not read next datablock if upperbound is reached 2d42cf5e Roundup read bytes in ReadaheadRandomAccessFile 264d3f54 Allow IntraL0 compaction in FIFO Compaction 8c3a180e Set lower-bound on dynamic level sizes 7c1c8ce5 Avoid calling fallocate with UINT64_MAX a45e98a5 max_open_files dynamic set, follow up 6b99dbe0 fix memory alignment with logical sector size e7ae4a3a Max open files mutable 60847a3b port: updated PhysicalCoreID() b551104e support PopSavePoint for WriteBatch 498693cf Remove orphaned Java classes 5e2ebf2b travis: add CMake compilation af6fe69e Fix an issue of manual / auto compaction data race 6798d1f3 Revert "Delete filter before closing the table" 89833577 Delete filter before closing the table 47a09b0a Avoid pinning when row cache is accessed aeaba07b Remove an assert that causes TSAN failure. 0b90aa95 Set VALGRIND_VER a2b05210 Make PosixLogger::flush_pending_ atomic da4b2070 Fix WriteBatchWithIndex address use after scope error d616ebea Add GPLv2 as an alternative license. 4439b459 Add documentation license 0ca3ead0 add GetRootDB() in DeleteFilesInRange cdad04b0 Remove double buffering on RandomRead on Windows. e15382c0 Disable two flaky tests 2150cc1f fix WritableFile buffer size in direct IO efc361ef Add user stats Reset API 6616e4d6 add prefetch to PosixRandomAccessFile in buffered io f6a27d0b Extract statistics tests into separate file 7eddecce support bulk loading with universal compaction 3b4d1b7a add <sys/sysmacros.h> to avoid warning with glibc 2.25 e5e545a0 Reunite checkpoint and backup core logic 72c21fb3 call GetRootDB() before cast to DBImpl* in CancelAllBackgroundWork 4c9447d8 Add erase option to release cache 04d58970 AIX and Solaris Sparc Support afff9951 Respect deprecated flag in table options 066cfbac Adding -noprofile to CMakeLists for Windows cb885bcc set compaction_iterator earliest_snapshot to max if no snapshot 7534ba7b StackableDB should pass ResetStats() c1fbf91b Fixing Solaris Sparc crash due to cached TLS 963eeba4 Revert how check_format_compatible.sh checkout release branches. 97005dbd tools/check_format_compatible.sh to cover option file loading too 8f619678 Add cpu usage to regression benchmarks (4th attempt) df74b775 Limit backups opened 1dd77605 Change L0 compaction score using level size 927bbab2 Revert "Add cpu usage to regression benchmarks (3rd attempt)" 8e84a388 Re-add index_per_partition but as deprecated 1553659d Add more recent versions to tools/check_format_compatible.sh 966ebb02 Hide event listeners from lite build 476e80be Add cpu usage to regression benchmarks (3rd attempt) c49d7046 Add DB:ResetStats() 0fcdccc3 Blob storage helper methods a6439d79 CMake: compile with -O2 e67f0adf enable O2 optimization for lz4 bc397325 CMake: add support for SSE4.2 7d5f5aa9 Separate compile and link for shared library 07165273 remove warning 6e8d6f42 readahead backwards from sst end ca96654d Change Build Env to gcc-5 e9e6e532 Simplify write thread logic 6799c7e0 Pass in remote as a param to branch creation script 44fa8ece change use_direct_writes to use_direct_io_for_flush_and_compaction 13b50358 add space for buggy kernel warning b6b9359e Fix BYTES_WRITTEN accounting 13369fbd Update ShipIt to honor TARGETS updates f2449ce9 Remove .deprecated_arcconfig 415be221 RocksDB Release 5.4 : Update HISTORY.md and build version. 3eab41d7 java dependencies test -s -> use test -d a22ed4ea internal_repo_rocksdb to build Java and RocksDB LITE 9f2cc59e sync TARGETS file 10d75469 set readahead buffer size from roundup(user_size) + 4k to roundup(use… ba7da434 fix db_stress crash caused by buggy kernel warning 6257837d Add ROCKSDB_JAVA_NO_COMPRESSION flag 6a6723ee Move MergeOperatorPinning tests to be with other merge operator tests 6a8d5c01 Revert "Report cpu usage using time command" 8f47a975 File level histogram should be printed per CF, not per DB 9300ef54 Fix shared lock upgrades 1f8b119e Limit maximum memory used in the WriteBatch representation 97ec8a13 Report cpu usage using time command 20778f2f Adding comments to the write path 7124268a Reduce the number of params needed to construct DBIter 04abb2b2 FreeBSD only requires WITH_JEMALLOC, not the rest 61730186 dummy diff 360e9960 Summary: Remove .arcconfig 69a5e646 Deprecate .arcconfig 9690653d Add a verify phase to benchmarks dd8f9e38 Fix compilation for GCC-5 c2954f9b Add Travis job to build examples 72fc1e9d avoid non-existent O_DIRECT on OpenBSD ff972870 Refactor compaction picker code 9e729390 only FALLOC_FL_PUNCH_HOLE when ftruncate is buggy 343b59d6 Move various string utility functions into string_util 1d068f60 Fix CompactRange incorrect buffer release df6f5a37 Move memtable related files into memtable directory 107c5f6a CMake: more MinGW fixes d2dce561 Move some files under util/ to separate dirs c50e3750 Use a human readable size for level report ce64b8b7 Divide db/db_impl.cc 02799ad7 Revert "delete fallocate with punch_hole" e2a7b202 Release note for partition filters af256eb2 build db every monday e5a1372b Rework test running script. d659faad Level-based L0->L0 compaction a12306fa Add a notice on gflags installation in INSTALL.md 43010a92 Revert "[rocksdb][PR] CMake: more MinGW fixes" a30b75cd Add buckifier script to github repo 3450ac8c CMake: more MinGW fixes 90cfd464 update IterKey that can get user key and internal key explicitly e2c6c063 add TimedEnv 9e445318 Refactor WriteImpl (pipeline write part 1) 6ef8c620 Move auto_roll_logger and filename out of db/ a1c469d7 Add release notes for PinnableSlice 0537f515 fix run_remote with strong quoting 72e60009 fixed misses on Centos library installation instructions 88cc81df auto_roll_logger_test to move away from real sleep d25e28d5 replace sometimes-undefined uint type with unsigned int a1d7e487 Add L0 write-amp to compaction level stats b6d60906 CMake: support AVX2 in MinGW bd7d1383 test remote instead run remote in regression test c81a805f test db existence on the remote host 5fc1e676 add -rf when remove db in regression test 4ab4049f gflags has moved to GitHub 4e006501 make all DB::Get overloads virtual 6401a8b7 Fix build with MinGW 80fe5b38 disable test: DeleteSchedulerTest.DynamicRateLimiting1 a9c86f51 backup garbage collect shared_checksum tmp files da175f7e exit with code 2 when there is already a db_bench running in regression test 0ee7f040 Added missing options to RocksJava c6d04f2e Option to fail a request as incomplete when skipping too many internal keys 58179ec4 Cleanup of ThreadStatusUtil structures should use the DB's reference f3607640 add ldb build to regression test 8a8c9674 Enable Fast CRC32 for Win64 f9813b85 Added SstFileWriter construtor without explicit comparator to JNI api 8d3cb4f2 Added naming of backup engine threads 67d76237 Expose the stalling information through DB::GetProperty() 0fd57492 delete fallocate with punch_hole 41fe9ad7 Hide usage of compaction_options_fifo from lite build e7731d11 Configure index partition size 69c8d524 Fix jni library name for PowerPC Architecture 34a70859 Fix segmentation fault caused by #1961 8dee8cad Enable fifo compaction benchmark to db_bench a5c8b543 fix a header include 91b5feb3 Fix Windows Build broken by a recent commit 41ccae6d Add C API functions (and tests) for WriteBatchWithIndex 88bb6f6b non_shm CI should run tests on /tmp 8888de2b Update .gitignore file in examples 203136e7 Fix Compilation errors when using IBM Java f4fce475 Fix clang compile error - [-Werror,-Wunused-lambda-capture] a084b26a Blog post for releasing 5.2.1 15950fe3 Remove ASSERT_EQ(boolean, ...) 3e56c7e0 make total_log_size_ atomic 909028e2 HISTORY.md for log_size_for_flush in CreateCheckpoint() be723a8d Optionally construct Post Processing Info map in MemTableInserter e474df94 db_bench: not need to check mmap for PlainTable 8b0097b4 Readers for partition filter 9ef3627f Allow checkpointing without flushing 17866ecc Allow Users to change customized ldb tools' header in help printing a2a88331 remove deleted option from benchmark.sh 78cb1955 add checkpoint to ldb 4b04addf updated solution if "make format" command fails 8f5bf044 Flush triggered by DB write buffer size picks the oldest unflushed CF 6908e24b dynamic setting of stats_dump_period_sec through SetDBOption() 93c68b64 change regression bash file with debug mode 21d8c317 remove LIKELY from public headers 36ad7577 INSTALL: document USE_SSE 9272e12f avoid ftruncate twice in buffered io d52f334c Break stalls when no bg work is happening e66221ad fix db_bench rate limiter callsites dbae438a Replace "DEPRECATED" comment to "not supported" 995618a8 Support SstFileManager::SetDeleteRateBytesPerSecond() e1916368 Add macros to include file name and line number during Logging d525718a cleanup direct io flag in WritableFileWriter 5fa927aa Add Xpress and ZSTD CompressionType values to C header 11526252 Pinnableslice (2nd attempt) e5bd8def update history.md for fixing the bug that skips keys 1ffbdfd9 Add a new SstFileWriter constructor without explicit comparator ebd5639b Add ability to search for key prefix in sst_dump tool e6725e8c Fix some bugs in MockEnv 900c62be fix compile for VS2015 fe183561 release 5.3 5dae0194 Revert "Report cpu usage using time command" f2817fb7 avoid ASSERT_EQ(false, ...); 5b11124e add max to histogram stats d43adf21 Report cpu usage using time command 18fc1bc0 minor changes for rate limiter test flakiness 12ba00ea Reset DBIter::saved_key_ with proper user key anywhere before pass to DBIter::FindNextUserEntry c9df05d1 Fix random access alignment f6499153 Add Bulkoading IngestExternalFile blog post 54b43411 Builders for partition filter 97edc72d Add a memtable-only iterator 72202962 fix db_sst_test flakiness 5f65dc87 Expose DB::DeleteRange and WriteBath::DeleteRange in Java 58b12dfe Set logs as getting flushed before releasing lock, race condition fix f8a4ea02 Move db_test and external_sst_file_test out of Travis's MAC OS run 534581a3 Fix a bug in tests in options operator= a2f7a514 Refactoring 2a5daa06 Add stderr log level for ldb backup commands 4561275c fix rate limiter test flakiness 7c80a6d7 Statistic for how often rate limiter is drained 0ad5af42 Clarify VerifyBackup behavior 6fb90134 sanitize readahead when direct read enabled f89b3893 Remove skip_table_builder_flush and default it to true cc253982 Use more default options in db_bench 8432bcf5 Make compaction_pri settable through option string d5b607a4 Make db_wal_test slightly faster ba4c77bd Divide external_sst_file_test e877afa0 Remove bulk loading and auto_roll_logger in rocksdb_lite 90d83550 Fix the wrong address for PREFETCH in DynamicBloom::Prefetch 08864df2 Move advanced column family options to advanced_options.h 2ca2059f Get unique_ptr to use delete[] for char[] in DumpMallocStats 253799c0 Add missing include for `abort()` c6d464a9 Fixed various memory leaks and Java 8 JNI Compatibility be3e5568 Fix unaligned reads in read cache 8ad0fcdf Separate small subset tests in DBTest 6c951c43 Run fewer tests in OSX f7997f13 add direct I/O to version notes 5.2.0 3b8ba703 Fix flaky DBTestUniversalCompaction.UniversalCompactionTrivialMoveTest2 96c7e150 Fix Java build e0b87afc Black list some slow valgrind tests e67232cf Handle failed Finish() in SST file writer 8efb5ffa [rocksdb][PR] Remove option min_partial_merge_operands and verify_checksums_in_comp… 1ba2804b Remove XFunc tests e7d902e6 add direct_io and compaction_readahead_size in db_stress 1ef5f50e detect logical sector size ed50308d check backup directory exists before listing children 4d7c06ce Make WriteBatchWithIndex moveble 5040414e Gracefully handle previous backup interrupted f206af56 add use_direct_io() to ReadaheadRandomAccessFile 08249344 truncate patch 286a36db posix writablefile truncate f0879e4c Page size isn't always 4k on linux 18eeb7b9 Fix interference between max_total_wal_size and db_write_buffer_size checks 1560b2f5 Temporarly return deprecated functions to fix MongoRocks build 2a0f3d0d level compaction expansion ebc8a799 alignment is on in ReadaheadRandomAccessFile::Read() 381fd322 Remove timeout_hint_us from WriteOptions fce7a6e1 Fail IngestExternalFile when bg_error_ exists a618a16f New subcode for IOError to detect the ESTALE errno 7ab00518 Remove deprecated DB::AddFile and DB::CompactRange 40166736 Adding Dlang to the list 756c5924 Allow adding external v1 sst file with no global seqno support aa0298fa Remove trailing whitespace from examples Makefile db2b4eb5 avoid direct io in rocksdb_lite 43e9f01c Fix repair_test on ROCKSDB_LITE 7106a994 Use monotonic time points in write_controller.cc and rate_limiter.cc c2247dc1 Make DBImpl::has_unpersisted_data_ atomic eb912a92 Remove disableDataSync option 0227c16d Update static library versions and add checksums b3aae4d0 Add repair_test to make check 421ce7c2 Add support for JNI Library on Linux on PowerPC. 9afa20cf Increase build version and HISTORY.md for releasing 5.2 a5adda06 Fix repair issues b48e4778 Consolidate file cutting logic in compaction loop ac2a77a7 Announce the experimetnal two-level index feature in HISTORY.md c4a37dcb Print the missed last layer in cfstats a12818af Blog post for 5.1.2 release 3b4ac807 Clarify ldb column family argument d70ce7ee Move db_bench flags out of unnamed namespace 186c7eed Remove incorrect statistics warning 53bb0151 [rocksdb][PR] compaction_style and compaction_pri should output their value as a st… 69d5262c Two-level Indexes 0a4cdde5 Windows thread 1aaa898c Adding GetApproximateMemTableStats method 9fc23c55 Use gcc-4.9-glibc-2.20-fb python in precommit_checker b797e421 Dump compression dictionary meta-block 036d668b Fix wrong result in data race case related to Get() 574b543f Rename merger.h -> merging_iterator.h add8b50c Move ThreadLocal implementation into .cc 71d2496a Fix arc setting for Facebook internal tools f289d9f4 Fix OSX build break after the fallocate change 4a3e7d32 Change the default of delayed slowdown value to 16MB/s 0513e21f RangeSync() should work with ROCKSDB_FALLOCATE_PRESENT not set 8b369ae5 Cleaner default options using C++11 in-class init ec79a7b5 Dedup code in option.cc and db_options.cc b96372de improving the C wrapper 04c4ec41 Change corruption_test to use 4 bits. 2d75cd40 NewLRUCache() to pick number of shard bits based on capacity if not given f25f1ec6 Add test DBTest2.GetRaceFlush which can expose a data race bug 37d4a79e Deserialize custom Statistics object in db_bench 3b35134e Avoid cache lookups for range deletion meta-block 94a0c32e Fix LRU Ref() for handles with external references only 17c11806 Generalize Env registration framework 07dddd5f EnvPosixTestWithParam should wait for all threads to finish 5dad9d6d Avoid logs_ operation out of DB mutex a7b13919 Fix CompactFiles() bug when used with CompactionFilter using SuperVersion 616a1464 Fix DeleteRange including sentinels in output files c918c4b7 Update USERS.md add user Pika 03ca2ac8 Remove function from DBImpl that are not used anywhere b0029bc7 Test merge op covered by range deletion in memtable d438e1ec Test range deletion block outlives table reader fba726e5 Version librocksdb.so 9da4d542 Range deletions unsupported in tailing iterator f2b4939d fixed typo 973f1b78 memtable: delete merge value for range deleteion aebfd170 fix non-portable behavior in encoder 753ff84a Fix get approx size d7ea44f2 Fixup a couple of builds errors on Linux. 537da370 c: allow set savepoint to writebatch af6ec4d7 fix batchresult handle leak e29bb934 Zlib 1.2.8 is no longer available, switched to 1.2.10 5ac97314 Fix std::out_of_range when DBOptions::keep_log_file_num is zero 4e35ffdf cmake: check -momit-leaf-frame-pointer before using it 3c0852d1 Make ingest external file backward compatible 0e8dfd60 Fix OptimizeForPointLookup() e840213d Change DB::GetApproximateSizes for more flexibility needed for MyRocks 9239103c Flush job should release reference current version if sync log failed da54d36a Disable IngestExternalFile in ReadOnly mode 5cf176ca Fix for 2PC causing WAL to grow too large 4a73bb0b Split travis jobs c70d3c7a Enable DBTest.GroupCommit as it runs in a reasonlable time now. 602c13a9 Remove fadvise with direct IO read f9d18e22 Fix DeleteRange file boundary correctness issue with max_compaction_bytes 3ce091fd Add KEEP_DB env var option 77b48066 Fix 2PC with concurrent memtable insert e8a09600 util/thread_local.h: silence a clang-build warning 324a0f98 Follow up for DirectIO refactor bc5d7b70 travis: For linux, do all tests under gcc 3e6899d1 change UseDirectIO() to use_direct_io() d4e07a84 fix warning of unused direct io helper functions dc2584ee direct reads refactor d18dd2c4 Abort compactions more reliably when closing DB 62384ebe Guarding extra fallocate call with TRAVIS because its not working pro… 9f246298 Performance: Iterate vector by reference fe395fb6 Allow incrementing refcount on cache handles 2172b660 Fix build on FreeBSD 3c233ca4 Fix Windows environment issues 76317345 Fix the error in ColumnFamiliesTest 7a02ad07 Update travis to ubuntu trusty 60c509ff Fix valgrind failure in test CurrentFileModifiedWhileCheckpointing2PC d0ba8ec8 Revert "PinnableSlice" 54d94e9c PinnableSlice e04480fa Fix MS warnings. Use ROCKSDB_Prsz for size_t. c081f721 5.0.1 release blog post ac73d755 Add GetSupportedCompressions() convenience function b104b878 Maintain position in range deletions map 640d7248 Update db_bench and sst_dump to test with block cache mid-point inser? 653ac1f9 C API: support total_order_mode 85ac1a32 Fix rocksdb::Status::getState 76711b6e Make ExternalSSTFileTest::CompactionDeadlock more deterministic c963460d Fix tests under GCC_481 33c86d67 Fix backupable db test e425ec11 utilities/backupable: backup should limit the copy size of wal. 0712d541 Delegate Cleanables d58ef52b Allow SstFileWriter to Fadvise the file away from page cache 17a4b75c Always fsync the file after file copying 2fb70dc7 examples: Add options_file_example to target all a738af8f db/pinned_iterators_manager.h: bugfix 906523d9 Add description to the 2PC checkpooint bug in HISTORY.md 438f22bc Fix bug of Checkpoint loses recent transactions with 2PC 335981d4 Fix the directory path for RocksDB repo 548b6280 Enable conditionally using adaptive mutexes 4e07b08e include/rocksdb/utilities/env_librados: fix typo ab48c165 Print cache options to info log 972f96b3 direct io write support 989e644e Remove sst_file_manager option from LITE 1beef656 Fix c_test 3d692822 persistent_cache: fix two timer 046099c9 The array is malloced by backtrace_symbols(), and must be freed 6ff2c8d7 Remove gflags as travis build dependency 3cd9ed1c Show sandcastle URL in phabricator 50e305de Collapse range deletions 5d1457db Dump persistent cache options 7bd725e9 db_bench: introduce --benchmark_read_rate_limit 29669184 Update Netflix section of USERS.md 342370f1 Simplify MemTable::Update 1a136c1f Expose file size fbff4628 Reduce compaction iterator status checks bd6cf7b5 WritableFileWriter: default buffer size equal min(64k,options.writabl? fc0c6fd9 "make format" format diff since last commit from master 816c1e30 gcc-7 requires include <functional> for std::function c2707358 Iterator should be in corrupted status if merge operator return false a8bf4d63 Make format shows wrong curl command for retrieving clang-format-diff.py 8f5d24ae C API: support get usage and pinned_usage for cache 0ab6fc16 Gcc-7 buffer size insufficient b7239bf7 Gcc 7 fallthrough 477b6ea5 std::remove_if requires <algorithm> 83f9a6fd Fail BackupEngine::Open upon meta-file read error a79eae4b Add pcache documentation images d71e728c Print user collected properties in sst_dump 7004a6f7 Add missing copyright header 3cdfaeca Fixes for MSVC compilation e097222e util/logging.cc: buffer of insufficient size (gcc-7 -Werror=format-length) cfc34d7c Missing break in case in DBTestBase::CurrentOptions bfbcec23 Gcc 7 error expansion to defined 6653e32a build: make it easier to pass PORTABLE 67adc937 intentional fallthough (prevents gcc-7/clang-4 error) 1a146f89 break Flush wait for dropped CF c3e5ee71 util/histogram.cc: HistogramStat::toString buffer insufficient 5334d8b4 table/block_based_table_builder.cc: intentional fallthrough - comment to match gcc pattern 36d42e65 Disable test to unblock travis build b57dd926 C API: support writebatch delete range 2ba59b5a Disallow ingesting files into dropped CFs 1f6f7e3e cast to signed char in ldb_cmd_test for ppc64le 243975d5 More accurate error status for BackupEngine::Open f0c509e2 Return finer-granularity status from Env::GetChildren* dc64f46b Add db_bench option for stderr logging 2cabdb8f Increase buffer size 4a17b47b Remove unnecessary header include 8c2b921f Fixed a crash in debug build in flush_job.cc 20ce081f Fix issue where IngestExternalFile insert blocks in block cache with g_seqno=0 5241e0db fix db_bench argument type c04f6a0b Specify shell in makefile 45c7ce13 CompactRangeOptions C API 2c2ba682 db_stress support for range deletions b821984d DeleteRange read path end-to-end tests 2f4fc539 Compaction::IsTrivialMove relaxing 1dce75b2 Update USERS.md 304b3c70 Update USERS.md fa50fffa Option to expand range tombstones in db_bench c26a4d8e Fix compile error in trasaction_lock_mgr.cc ed8fbdb5 Add EventListener::OnExternalFileIngested() event 2005c88a Implement non-exclusive locks 0b0f2357 Mention IngestExternalFile changes in HISTORY.md 23db48e8 Update HISTORY.md for 5.0 branch beb36d9c Fixed CompactionFilter::Decision::kRemoveAndSkipUntil 67f37cf1 Allow user to specify a CF for SST files generated by SstFileWriter 9053fe2a Made delete_obsolete_files_period_micros option dynamic edde954e fix clang build 56281f3a Add memtable_insert_with_hint_prefix_size option to db_bench 4a21b140 Cache heap::downheap() root comparison (optimize heap cmp call) e39d0808 Fix travis (compile for clang < 3.9) 3f407b06 Kill flashcache code in RocksDB b77007df Bug: paralle_group status updated in WriteThread::CompleteParallelWorker 247d0979 Support for range skips in compaction filter 96fcefbf c api: expose option for dynamic level size target 00197cff Add C API to set base_backgroud_compactions 5b219ecc deleterange end-to-end test improvements for lite/robustness aad11917 pass rocksdb oncall to mysql_mtr_filter otherwise tasks get created w… e3335289 DeleteRange write path end-to-end tests 7784980f Fix mis-reporting of compaction read bytes to the base level 3c6b49ed Fix implicit conversion between int64_t to int b3b87565 Remove unused assignment in db/db_iter.cc 4f6e89b1 Fix range deletion covering key in same SST file a2bf265a Avoid intentional overflow in GetL0ThresholdSpeedupCompaction 52fd1ff2 disable UBSAN for functions with intentional -ve shift / overflow 1886c435 Fix CompactionJob::Install division by zero 63c30de8 fix options_test ubsan 13e66a8f Fix compaction_job.cc division by zero 01eabf73 Fix double-counted deletion stat 7ffb10fc DeleteRange compaction statistics 236d4c67 Less linear search in DBIter::Seek() when keys are overwritten a lot cd7c4143 Improve Write Stalling System dfb6fe67 Unified InlineSkipList::Insert algorithm with hinting 3068870c Making persistent cache more resilient to filesystem failures 734e4aca Eliminate redundant cache lookup with range deletion 182b940e Add WriteOptions.no_slowdown 4118e133 Persistent Cache: Expose stats to user via public API f2a8f92a rocks_lua_compaction_filter: add unused attribute to a variable 4444256a Remove use of deprecated LZ4 function 548d7fb2 Fix fd leak when using direct IOs fd43ee09 Range deletion microoptimizations 23a18ca5 Reword support a little bit to more clear and concise 481856ac Update support to separate code issues with general questions a0deec96 Fix deadlock when calling getMergedHistogram fe349db5 Remove Arena in RangeDelAggregator e63350e7 Use more efficient hash map for deadlock detection a13bde39 Skip ldb test in Travis 73843aa6 Direct I/O Reads Handle the last sector correctly. 9d60151b Implement PositionedAppend for PosixWritableFile 3f622152 Lazily initialize RangeDelAggregator's map and pinning manager 41e77b83 cmake: s/STEQUAL/STREQUAL/ c1038d28 Release RocksDB 5.0 635a7bd1 refactor TableCache Get/NewIterator for single exit points f39452e8 Fix heap use after free ASAN/Valgrind a4eb7387 Allow plain table to store index on file with bloom filter disabled 36e4762c Remove Ticker::SEQUENCE_NUMBER 86eb2b9a Fix src.mk 0765babe Remove LATEST_BACKUP file 647eafdc Introduce Lua Extension: RocksLuaCompactionFilter 760ef68a fix deleterange asan issue 327085b7 fix valgrind 715591bb Ask travis to use JDK 7 972e3ff2 Enable allow_concurrent_memtable_write and enable_write_thread_adaptive_yield by default 420bdb42 option_change_migration_test: force full compaction when needed 1543d5d9 Report memory usage by memtable insert hints map. 018bb2eb DeleteRange support for db_bench dc51bd71 CMakeLists.txt: FreeBSD has jemalloc as default malloc 48e8baeb Decouple data iterator and range deletion iterator in TableCache 4b0aa3c4 Fix failed compaction_filter_example and add it into make all 53b693f5 ldb support for range delete 661e4c92 DeleteRange unsupported in non-block-based tables 489d1428 DeleteRange interface eba99c28 Fix min_write_buffer_number_to_merge = 0 bug 2ef92fea Remove all instances of relative_url until GitHub pages problem is fixed. 91300d01 Dynamic max_total_wal_size option ec2f6479 Consider subcompaction boundaries when updating file boundaries for range deletion 800e5155 Fix CSS issues again b952c898 Parallize persistent_cache_test and transaction_test 3b192f61 Handle full final subcompaction output file with range deletions 6c579520 Make range deletion inclusive-exclusive 425210cc CSS issues are arising on the Github Pages side. Temp fix. 1ea79a78 Optimize sequential insert into memtable - Part 1: Interface df5eeb85 Optimize sequential insert into memtable - Part 2: Implementation 5ed65085 Fix SstFileWriter destructor adb665e0 Allowed delayed_write_rate option to be dynamically set. 307a4e80 sst_dump support for range deletion 361010d4 Exporting compaction stats in the form of a map 672300f4 Use relative Urls for stylesheets b39b2ee1 do not call get() in recovery mode 1ca5f6d1 Fix 2PC Recovery SeqId Miscount e095d0cb Rocksdb contruns to new Sandcastle API 14c0380e Convenience option to parse an internal key on command line c90fef88 fix open failure with empty wal 4e20c5da Store internal keys in TombstoneMap a9fb346e Fix RocksDB Lite build failure in c_test.cc d133b08f Use correct sequence number when creating memtable 144cdb8f 16384 as e.g .value for compression_max_dict_bytes 9bd191d2 Fix deadlock between (WriterThread/Compaction/IngestExternalFile) a9fae0a9 CSS problems again :( 193221e0 Fix Forward Iterator Seek()/SeekToFirst() e48f3f8b remove tabs and duplicate #include in c api 85bd8f51 Minor fix to GFLAGS usage in persistent cache a7875272 c: support seek_for_prev 0f17f927 Make the header links a bit more flexible cf19f559 single quotes in feed 2dc019e0 Fix header links f1aedda0 More Jekyll 3.3 fixes c54cdc37 More Jekyll 3.3 updates 2bcaf824 Update product and feature template for Jekyll 3.3 24bceb09 Java API - Implement GetFromBatch and GetFromBatchAndDB in WBWI 815f54af Insert range deletion meta-block into block cache 9e7cf346 DeleteRange user iterator support 5c5d01ae Fix wrong comment (Maximum supported block size) f998c979 DeleteRange Get support 879f3663 Add C api for RateLimiter 557034f3 Remove all instances of baseurl 437942e4 Add avoid_flush_during_shutdown DB option 2b16d664 Change max_bytes_for_level_multiplier to double 16fb0443 expose IngestExternalFile to c abi ce22ea99 Fix casts for MSVC 196af035 Introduce FAIL_ON_WARNINGS CMake variable (default ON) 40a2e406 DeleteRange flush support d5555d95 Fix MSVC compile error in 32 bit compilation da61f348 Print compression and Fast CRC support info as Header level f9eb5679 db_bench: --dump_malloc_stats takes no effect 6a4faee5 fix freebsd build include path err and so & jar file name c90c48d3 Show More DB Stats in info logs 1b295ac8 DBTest.GetThreadStatus: Wait for test results for longer 25f5742f Update documentation to point at gcc 4.8 b50a81a2 Add a test for tailing_iterator 04751d53 L0 compression should follow options.compression_per_level if not empty 2946cadc Improve RangeDelAggregator documentation 0a9fd05c Update Vagrant file (test internal phabricator workflow) fcd1e0bf Make rocksdb work with internal repo 0aab5e55 FreeBSD: malloc_usable_size is in <malloc_np.h> (#1428) 9c0bb7f1 cmake: drop "-march=native" from CXX_FLAGS (#1429) eeb27e1b Add handy option to turn on direct I/O in db_bench (#1424) c6168d13 removed some declarations from c.h which resulted in undefined symbols (#1407) bc429de4 revert fractional cascading in farward iterator b9bc7a2a Use skiplist rep for range tombstone memtable 60a2bbba Makefile: generate util/build_version.cc from .in file (#1384) 9ee84067 Disable DBTest.RepeatedWritesToSameKey (#1420) f41df304 OptionChangeMigration() to support FIFO compaction 2e8004e6 Changing the legocastle run to use valgrind_test instead of _check 9de2f752 revert Prev() in MergingIterator to use previous code in non-prefix-seek mode 24495186 DBSSTTest.RateLimitedDelete: not to use real clock 1168cb81 Fix a bug that may cause a deleted row to appear again 99c052a3 Fix integer overflow in GetL0ThresholdSpeedupCompaction (#1378) f83cd64c Fix a bug that mistakenly disable regression_test.sh to update commit (#1415) 0e926b84 Passing DISABLE_JEMALLOC=1 to valgrind_check if run locally 4dfaa661 Make IsDeadlockDetect() virtual member of Transaction 59a7c033 Change ioptions to store user_comparator, fix bug 869ae5d7 Support IngestExternalFile (remove AddFile restrictions) 1d9dbef6 Restrict running condition of UniversalCompactionTrivialMoveTest2 4edd39fd Implement deadlock detection 48fd619a Minor fixes to RocksJava Native Library initialization (#1287) 48e4e842 Disable auto compactions in memory_test and re-enable the test (#1408) fb2e4129 column_family_test: disable some tests in LITE 5af651db fix data race in compact_files_test a0ba0aa8 Fix uninitialized variable gcc error for MyRocks b88f8e87 Support SST files with Global sequence numbers [reland] 08616b49 [db_bench] add filldeterministic (Universal+level compaction) 52c9808c not split file in compaciton on level 0 5e0d6b4c fix db_stress assertion failure ab539983 Bump RocksDB version to 4.13 (#1405) b4d07123 SamePrefixTest.InDomainTest to clear the test directory before testing aa09d033 Avoid calling GetDBOptions() inside GetFromBatchAndDB() 6fbe96ba Compaction Support for Range Deletion 257de78d Remove "-Xcheck:jni" from Java tests (#1402) d88dff4e add seeforprev in history 5027dd17 Fix a minor bug in the ldb tool that was not selecting the specified (#1399) fea6fdd6 Fix @see in two Java functions (#1396) b1031d6c Remove function local statics that interfere with memory pooling (#1392) f4705401 Handle WAL deletion when using avoid_flush_during_recovery e29d3b67 Make max_background_compactions and base_background_compactions dynamic changeable 21e8dace fix assertion failure in Prev() b9311aa6 Implement WinRandomRW file and improve code reuse (#1388) a249a0b7 check_format_compatible.sh to use some branch which allows to run with GCC 4.8 (#1393) 040328a3 Remove an assertion for single-delete in MergeHelper::MergeUntil 8cbe3e10 Relax the acceptable bias RateLimiterTest::Rate test be 25% f26a139d Log successful AddFile 5691a1d8 Fix compaction conflict with running compaction 017de666 fixup commit 1b7af5fb Redo handling of recycled logs in full purge 27bfe327 Editorial change to README.md 89cc404d A bit of doc restructuring 9e7fda82 Fix arcanist 2e4b5cab Add missing RateLimiter class to the Windows build (#1382) ce4963fd [doc] Document that Visual Studio 2015+ is now required for Windows builds (#1389) e4892709 Fix scoped arena iterator (#1387) f8d8cf53 Fix log_write_bench -bytes_per_sync option. (#1375) 02b3e398 Make txn->GetState() const 447f1712 new Prev() prefix support using SeekForPrev() 991b585e More block cache tickers d6ae6dec Add Statistics::getAndResetTickerCount(). aea3ce4c Avoid string CONCAT which is not supported in cmake 2.6 (#1383) 2ad68b97 Support running consistency checks in release mode 67501cfc Fix -ve std::string::resize 04b02dd1 Testing asset links after config change 8c55bb87 Make Lock Info test multiple column families d0623289 Revert "Support SST files with Global sequence numbers" 5cd28833 [RocksJava] Adjusted RateLimiter to 3.10.0 (#1368) 37737c3a Expose Transaction State Publicly 2c1f9529 Add facility to write only a portion of WriteBatch to WAL 043cb62d Fix record_size in log_write_bench, swap args to std::string::assign. (#1373) 4985f60f env_mirror: fix a few leaks (#1363) 5aded67d update of c.h (#1371) 912aec13 "Recent Posts" -> "All Posts" 7cbb298d Make sure that when contribtuing we call out creating appropriate directories a06ad471 Add top level doc information to CONTRIBUTING.md 3fdd5b97 A little more generic CONTRIBUTING.md ed4fc31d Add link to CONTRIBUTING.md to main docs README.md e4922e18 Forgot to truncate one blog post 6d8cd7ed Add CONTRIBUTING.md for rocksdb.org contribution guidance bd55e5a1 Fix some formatting of compaction blog post 0f60358b CRLF -> LF mod (including removing trailing whitespace for those files) b90e29c9 Truncate posts on the main /blog/ page 0d7acada Add author fields to blog posts 01be4418 Add GitHub link to the landing page header 9d6c9613 Fix Mac build ab01da54 Support SST files with Global sequence numbers d346ba24 Minor fixes around Windows 64 Java Artifacts (#1366) e91b4d0c Add factory method for creating persistent cache that is accessible from public be1f1092 Expose transaction id, lock state information and transaction wait information 6009c473 Store range tombstones in memtable 3c21c64c Use size hint for HashMap in multiGet. Similar to https://github.com/facebook/rocksdb/pull/1344 (#1367) 13f7a01f Fixing JNI release build for gcc (#975) 7260662b Add Java API for SstFileWriter 26388247 delete unused variable for PrevInterval() 87dfc1d2 Fix conflict between AddFile() and CompactRange() eb44ed65 Update 2016-09-28-rocksdb-4-11-2-released.markdown e4437610 Update 2016-09-28-rocksdb-4-11-2-released.markdown 501f0510 Update 2016-09-28-rocksdb-4-11-2-released.markdown dec9009f Update 2016-09-28-rocksdb-4-11-2-released.markdown 4ed69dd0 Create 2016-09-28-rocksdb-4-11-2-released.markdown 21f4bb5a cmake support for linux and osx (#1358) 4defe306 fix typo in comments (#1360) f517d9dd Add SeekForPrev() to Iterator eb3894cf Recompute compaction score on SetOptions (#1346) 5c64fb67 Fix AddFile() conflict with compaction output [WaitForAddFile()] 9e9f5a0b Fix CompactFilesTest.ObsoleteFiles timeout (#1353) c2a62a4c not cut compaction output when compact to level 0 9ed928e7 Split DBOptions into ImmutableDBOptions and MutableDBOptions 4bc8c88e Recover same sequence id from WAL (#1350) 0a1bd9c5 add cfh deletion started listener da5a9a65 Fix mac build d45eb6c6 Fix typo (#1349) abc0ae46 Add AddFile() InternalStats for Total files/L0 files/total keys ingested 71525633 forbid merge during recovery 5735b3dc Fix compiling under -Werror=missing-field-initializers 654ed9a2 loose the assertion condition of rate_limiter_test e4d3f5d9 Fix DBImpl::GetWalPreallocateBlockSize Mac build error 7afbb742 solve the problem of table_factory_to_write_=nullptr (#1342) d78a4401 DBImpl::GetWalPreallocateBlockSize() should return size_t 42ac9c5f Retry getting arcanist token on failure b666f854 Consider more factors when determining preallocation size of WAL files 4c3f4496 Add TableBuilderOptions::level and relevant changes (#1335) 3edb9461 Avoid hard-coded sleep in EnvPosixTestWithParam.TwoPools 0a88f38b Remove ColumnFamilyData::options() 41a9070f Fix java makefile dependencies 8d9bf5c4 Fix DBOptionsTest.GetLatestOptions 40cfa3e0 Fix DBWALTest.RecoveryWithLogDataForSomeCFs with mac 06b4785f Fix recovery for WALs without data for all CFs d7242ff4 Fix GetSortedWalFiles when log recycling enabled 17f76fc5 DB::GetOptions() reflect dynamic changed options 215d1282 Fix typo (#903) a958c264 Rename jvalue to jval in rocksjni 0a165bd7 Have Facebook link point to RocksDB on FB 3639f328 Fix bug in UnScSigned-off-by: xh931076284 <931076284@qq.com> (#1336) 8e061f97 Refactor GetMutableOptionsFromStrings 81747f1b Refactor MutableCFOptions ba65c816 Support POSIX RandomRWFile 1d980a8e Create CNAME 2adab1dd Add API links to the header bar a182b298 Preserve blog comments in markdown f54de923 Adding Dgraph to list of Users (#1291) 9e4aa798 Summary: (#1313) a10e8a05 Fix C api memtable rep bugs. (#1328) eb1d4d53 Release RocksDB 4.12 22d88e24 Allow an offset as well as a length to be specified for byte[] operations in RocksJava JNI (#1264) b06b1913 add C api for set wal_recovery_mode (#1327) 1cca0912 Temporarily revert Prev() prefix support de28a255 Update HISTORY.md for thread-local stats 0fcb6dbe Remove extraneous function prototypes from c.h (#1326) 52ee07b0 Move AddFile() tests to external_sst_file_test.cc 66a91e26 Add NoSpace subcode to IOError (#1320) 67036c04 Fix Flaky ColumnFamilyTest.FlushCloseWALFiles 0e2da497 fix typo in option.h's comment (#1321) 6d61358a Add real Google Analytics ID 2d9d36ea Have "Edit on GitHub" point to master instead of gh-pages 93775189 Update landing page content 1ec75ee7 Add redirects from old blog posts link to new format 607628d3 Support ZSTD with finalized format ce1be2ce Fix build error on Windows (AppVeyor) (#1315) f7669b40 Fix Windows Build 22696b08 Fix uninitlized CompactionJob::SubcompactionState::current_output_file_size c1865e0f Trigger more tests per diff a88677d2 Remove ImmutableCFOptions from public API 80c75593 Fix data race in AddFile() with multiple files + custom comparator bug 5051755e Fix db_bench memory use after free (detected by clang_analyze) 4fd08f4b Ensure Correct Behavior of StatsLevel kExceptDetailedTimers and kExceptTimeForMutex (#1308) e14fbaae Add FAQ based on the front page of the current rocksdb.org 3c226240 Migrate the RocksDB Worpdress blog over to Jekyll ee0e2201 Transfer the current Getting Started contents to GitHub Pages 5a0e9a4c Initial Landing Page 9447a854 Remove the `doc` directory 32149059 Merge options source_compaction_factor, max_grandparent_overlap_bytes and expanded_compaction_factor into max_compaction_bytes 4590b53a add stats to Cache::LookUp() 85bb3082 Expose Utility function StringToMap() (#1306) 8ce1b844 Fix Travis on Mac 380e651a Fix Mac build failure (#1309) 1613fa94 Thread-specific histogram statistics 6a14d55b add prefix_seek_mode to db_iter_test de47e2bd Fix ClockCache memory leak f099af4c Fix travis db74b1a2 fix bug in merge_iterator when data race happens b18f9c9e add nullptr check to internal_prefix_transform 4e395e87 Update docs README.md 2482d5fb support Prev() in prefix seek mode 7541c7a7 Fix cache_test valgrind_check failure c8513cde Update the download location of Snappy (#1304) b49b92cf Introduce Read amplification bitmap (read amp statistics) c7004840 store prefix_extractor_name in table 4ad928e1 add comment to SimCache to estimate actual capacity e9b2af87 Expose ThreadPool under include/rocksdb/threadpool.h 23a05700 Document memtable flush behavior in CancelAllBackgroundWork() dade61ac Mitigate regression bug of options.max_successive_merges hit during DB Recovery cce702a6 [db_bench] Support single benchmark arguments (Repeat for X times, Warm up for X times), Support CombinedStats (AVG / MEDIAN) 3586901f cat tests logs sorted by exit code b2ce5953 Persist data during user initiated shutdown 4b3438d2 Fix parallel valgrind (valgrind_check) a081f798 Relax consistency for thread-local ticker stats b10d65c2 Update and slightly clarify instructions in build_detect_platform (#1301) f85f99bf Fix the Windows build of RocksDB Java. Similar to https://github.com/facebook/rocksdb/issues/1220 (#1284) 7b810951 Fix a crash when compaction fails to open a file 7c958683 Thread-specific ticker statistics ea9e0757 Add initial GitHub pages infra for RocksDB documentation move and update. (#1294) 2a9c9710 [Flaky Test] Disable DBPropertiesTest.GetProperty d76ddf32 Disable ClockCache db_crashtest cec2c643 fix data race in NewIndexIterator() in block_based_table_reader.cc badbff65 Not insert into block cache if cache is full and not holding handle 4a16c32e Option to cache index/filter blocks with priority 99c4af71 Make ClockCache available with TSAN build f57bc1d0 Fix lambda expression for clang/windows 5440675c Fix lambda capture expression for windows 6584cec8 Fold function for thread-local data 817eeb29 Add singleDelete to RocksJava (#1275) ffdf6eee Add Status to RocksDBException so that meaningful function result Status from the C++ API isn't lost (#1273) ecf90038 Fix bug in printing values for block-based table 72f8cc70 LRU cache mid-point insertion 6a17b07c Add TablePropertiesCollector support in SstFileWriter 78837f5d TableBuilder / TableReader support for range deletion 4cc37f59 Introduce ClockCache ff17a2ab Adding TBB as dependency. 49d88be0 c abi: allow compaction filter ignore snapshot (#1268) 0b63f51f fixes 1215: execute_process(COMMAND mkdir ${DIR}) fails to create a directory with cmake on Windows (#1219) 3981345b Small nits (#1280) 2a2ebb6f Move LRUCache structs to lru_cache.h header 2fc2fd92 Single Delete Mismatch and Fallthrough statistics 3771e379 WriteBatch support for range deletion 236756f2 Make SyncPoint return immediately when disabled 64a0082c Fix DBSSTest::AddExternalSstFileSkipSnapshot valgrind fail dd7a748c Fix java build 4fe12baa Make db_bench less space for --stats_per_interval 6525ce4c Compaction stats printing: "batch" => "commit group" a117891b Fixed typo (#1279) b248e98c Fix a destruction order issue in ThreadStatusUpdater deda159b Added min/max/avg data block size output to sst_dump e408e98c add Name() to Cache a297643f Fix valgrind memory leak d11c09d9 Eliminate memcpy from ForwardIterator d3675550 Added further Java API options for controlling concurrent writes ebdfe34c Exposed further Java API options for controlling compaction d1be5946 Improve documentation of SliceTransform. 6056d631 Improve comment and bug fix for GetOptionsFromMap functions in convenience.h 76a67cf7 support stackableDB as the baseDB of transactionDB 67c1ae88 Travis build break fix b693ba68 Minor PinnedIteratorsManager Refactoring db3dfb16 Fixes for arcanist config (#1271) 87c91bd8 Persistent Read Cache (8) Benchmark tooling 2914de64 add sim_cache stats to Statistics 8b79422b [Proof-Of-Concept] RocksDB Blob Storage with a blob log file. 4beffe00 Fix test data race in two FaultInjectionTest tests 821bcb0b util/arena.cc: FreeBSD: More portable use of mmap(MAP_ANON) (#1254) 5370f44a Increase RocksDB version 56dd0341 read_options.background_purge_on_iterator_cleanup to cover forward iterator and log file closing too. ccecf3f4 UniversalCompaction should ignore sorted runs being compacted (when compacting for file num) 1b0069ce Remove non-gtest from parallelized tests 638c49f2 Change HISTORY.md for release 4.11 6b8e9c68 fix vs generator (#1269) c38b075e Update HISTORY.md 8f399e3f Update HISTORY.md 98d0b78e Added check_snapshot option in the DB's AddFile function (#1261) 9fd68b7f set travis open file descriptor limit 59ddb505 Fix travis build break f4d98636 Added SetOptions support to RocksJava (#1243) 7882cb97 Make DBOptionsTest::EnableAutoCompactionAndTriggerStall less falky 44f5cc…
For every multiGet call, a HashMap is ultimately created and returned to
the caller. This HashMap is never created with a capacity hint, meaning
that resizes during map buildup are likely. We know the upper bound on
the number of items that will be placed in the map (
values.length
)which we can use to size the map appropriately on creation.
values.length
is only an upper bound though because some entries invalues
can be null.