Upgrade to RocksDB 5.8.8 #10

andresilva · 2017-12-13T16:02:33Z

I accidently deleted the branch and GitHub automatically closed the PR. For some reason GitHub didn't let me reopen the existing PR.

All the tests in paritytech/parity are passing and I built a new parity release which is currently syncing properly.

6f35cb93 bump version c1565071 update history dd0efa4e Preserve overlapping file endpoint invariant aead4041 fix HISTORY.md typo a0cdc3ce Bump version to 5.8.7 7513f635 Fix IOError on WAL write doesn't propagate to write group follower 9e47084c Bump version to 5.8.6 36074ba5 Enable cacheline_aligned_alloc() to allocate from jemalloc if enabled. aa00523e Add -DPORTABLE=1 to MSVC CI build cf2b9823 Bump version to 5.8.5 e8c9350f Blob DB: not using PinnableSlice move assignment 4907d246 Bump version to 5.8.4 5d928c79 Blob DB: Fix race condition between flush and write 725bb9d6 Blob DB: Fix release build b7367fe8 Bump version to 5.8.3 13b2a9b6 Blob DB: use compression in file header instead of global options 5dc70a15 Fix PinnableSlice move assignment 9019e912 dynamically change current memtable size 7f1815c3 Bump version to 5.8.2 2584a18e Blob DB: Fix BlobDBTest::SnapshotAndGarbageCollection asan failure 17f67b54 PinnableSlice move assignment 6fb56c58 Blob DB: Add compaction filter to remove expired blob index entries f90ced92 Blob DB: fix snapshot handling 632f36dc Blob DB: option to enable garbage collection 11bacd57 Blob DB: Fix flaky BlobDBTest::GCExpiredKeyWhileOverwriting test f98efcb1 Blob DB: Evict oldest blob file when close to blob db size limit c1e99edd Blob DB: cleanup unused options ffc3c62c Blob DB: Initialize all fields in Blob Header, Footer and Record structs 9e825409 Blob DB: update blob file format d66bb21e Blob DB: Inline small values in base DB 05d5c575 Return write error on reaching blob dir size limit 2b8893b9 Blob DB: Store blob index as kTypeBlobIndex in base db 419b93c5 Blob DB: not writing sequence number as blob record footer 8afb0036 fix lite build dded348d Blob DB: Move BlobFile definition to a separate file 37473612 add GetLiveFiles and GetLiveFilesMetaData for BlobDB 8cff6e94 Enable WAL for blob index c2934729 Add ValueType::kTypeBlobIndex eae53de3 Make it explicit blob db doesn't support CF 65aec19d Fix memory leak on blob db open 30b38c98 TableProperty::oldest_key_time defaults to 0 2879f4be Bump version to 5.8.1 88595c88 Add DB::Properties::kEstimateOldestKeyTime 266ac245 Bumping version to 5.8 64185c23 update HISTORY.md for DeleteRange bug fix e83d6a02 Not using aligned_alloc with gcc4 + asan 0980dc6c Fix wrong smallest key of delete range tombstones b7679723 avoid use-after-move error c4174427 CMake: Fix formatting c21ea8f7 CMake: Add support for CMake packages 54443455 add Erlang to the list of language bindings 2972a702 Minor updates to FlushWAL blog fbfa3e7a WriteAtPrepare: Efficient read from snapshot list b01f426f Blog post for FlushWAL 503db684 make blob file close synchronous 3c840d1a Allow DB reopen with reduced options.num_levels 92bfd6c5 Fix DropColumnFamily data race 7fdf735d Pinnableslice examples and blog post 7fbb9ecc support disabling checksum in block-based table 19cc66dc fix clang bug in block-based table reader 7eba54eb test compaction input-level split range tombstone assumption cd26af34 Add unit test for WritePrepared skeleton a1247981 Improved transactions support in C API c10b3913 LANGUAGE-BINDINGS.md: add another rust binding 90177432 Remove leftover references to phutil_module_cache 234f33a3 allow nullptr Slice only as sentinel ccf7f833 Use PinnableSlice in Transactions 1dfcdb15 Extend pin_l0 to filter partitions 39ef9005 stop calling memcmp with nullptrs 78cb6b61 Provide byte[] version of SstFileWriter.merge to reduce GC Stall 867fe92e Scale histogram bucket size by constant factor f004307e CMake improvements 09ac6206 Circumvent ASAN false positive 5b68b114 Blob db create a snapshot before every read 4624ae52 GC the oldest file when out of space 8ace1f79 add counter for deletion dropping optimization 0d8e992b Revert the mistake in version update 5358a805 add VerifyChecksum to HISTORY.md ed0a4c93 perf_context measure user bytes read 1efc600d Preload l0 index partitions bddd5d36 Added mechanism to track deadlock chain c1384a70 fix db_stress uint64_t to int32 cast 29877ec7 Fix blob db crash during calculating write amp 8f2598ac Enable Cassandra merge operator to be called with a single merge operand 9a44b4c3 Allow merge operator to be called even with a single operand ac8fb77a fix some misspellings 23593171 minor improvements to db_stress af012c0f fix deleterange with memtable prefix bloom 1c8dbe2a update scores after picking universal compaction eb642530 Update WritePrepared with the pseudo code 132306fb Remove PartialMerge implementation from Cassandra merge operator 71598cdc Fix false removal of tombstone issue in FIFO and kCompactionStyleNone 3204a4f6 Fix missing stdlib include required for abort() 7aa96db7 db_stress rolling active window dfa6c23c Update RocksDBCommonHelper to use escapeshellarg e367774d Overload new[] to properly align LRUCacheShard ad42d2fc Remove residual arcanist_util directory 279296f4 properly set C[XX]FLAGS during CMake configure-time checks c5f0c6cc compile with correct flags to determine SSE4.2 support 185ade4c cmake: support more compression type 5449c099 rocksdb: make buildable on aarch64 a144a978 Fix for CMakeLists.txt on Windows for RocksJava acf935e4 fix deletion dropping in intra-L0 8254e9b5 make sst_dump compression size command consistent 74f18c13 db_bench support for non-uniform column family ops 5de98f2d approximate histogram stats to save cpu 3f588843 Fix c_test ASAN failure e5a1b727 Fix blob DB transaction usage while GC 6f051e0c fix corruption_test valgrind ac098a46 expose set_skip_stats_update_on_db_open to C bindings 666a005f Support prefetch last 512KB with direct I/O in block based file reader ad77ee0e Revert "Makefile: correct faligned-new test" b87ee6f7 Use more keys per lock in daily TSAN crash test 25df2425 Add column families related functions (C API) 64f84843 block_cache_tier: fix gcc-7 warnings 0cecf815 Write batch for `TransactionDB` in C API 6a9de434 Windows.h macro call fix 23c7d135 fix comment 1fbad84b Makefile: correct faligned-new test 7848f0b2 add VerifyChecksum() to db.h 47ed3bfc fix WinEnv assertions d97a72d6 Try to repair db with wal_dir option, avoid leak some WAL files 36375de7 gcc-7/i386: markup intentional fallthroughs bdc056f8 Refactor PessimisticTransaction a9a4e89c Fix valgrind complaint about initialization 4ca11b4b Update USERS.md c9804e00 Refactor TransactionDBImpl 20dc5e74 Optimize range-delete aggregator call in merge helper. 0d4a2b73 Avoid blob db call Sync() while writing 627c9f1a Don't add -ljemalloc when DISABLE_JEMALLOC is set dce6d5a8 db_bench background work thread pool size arguments 4f81ab38 Makefile: fix for GCC 7+ and clang 4+ 92afe830 Update all blob db TTL and timestamps to uint64_t 5883a1ae Fix /bin/bash shebangs cc01985d Introduce bottom-pri thread pool for large universal compactions 0b814ba9 Allow concurrent writes to blob db 2c45ada4 Blob DB garbage collection should keep keys with newer version 58410aee Fix the overflow bug in AwaitState c3d5c4d3 Refactor TransactionImpl 060ccd4f support multiple CFs with OPTIONS file 34538706 Fix statistics in RocksJava sample 1900771b Dump Blob DB options to info log 3218edc5 Fix universal compaction bug 6a36b3a7 fix db get/write stats a84cee81 Add a missing "once" in .h 21696ba5 Replace dynamic_cast<> e85f2c64 Prevent empty memtables from using a lot of memory ac748c57 Fix FIFO Compaction with TTL tests aaf42fe7 Move blob_db/ttl_extractor.h into blob_db/blob_db.h aace4651 Fix license headers in Cassandra related files 50a96913 CacheActivityLogger, component to log cache activity into a file 6083bc79 Blob DB TTL extractor 710411ae fix asan/valgrind for TableCache cleanup 3a3fb00b TARGETS file not setting sse explicitly fca4d6da Build fewer tests in Travis platform_dependent tests 8f553d3c remove unnecessary internal_comparator param in newIterator 7f6d012d "ccache -C" in Travis d12691b8 move TableCache::EraseHandle outside of db mutex f33f1136 fix db_bench argument type e7697b8c Fix LITE unit tests 3ce20e98 Fix use of RocksDBCommonHelper in cont_integration.sh c281b448 Revert "CRC32 Power Optimization Changes" 9980de26 Fix FIFO compaction picker test 2289d381 CRC32 Power Optimization Changes 30b58cf7 Remove the orphan assert on !need_log_sync fe1a5559 Fix flaky write_callback_test addbd279 5.6.1 release blog post 30edff30 buckification: remove explicit `-msse*` compiler flags 2b259c9d Lower num of iterations in DeadlockCycle test 277f6f23 Release note for partitioned index/filters 5e731a13 Remove unused rocksdb arcanist lib 9b11d434 Fix broken links 06f19174 add vcpkg as an windows option ea8ad4f6 Fix compaction div by zero logging 34112aef Added db paths to c 1d8aa296 Gcc 7 ParsedInternalKey replace memset with clear function. a4c42e80 Fix UBSAN issue of passing nullptr to memcmp 16e03882 LRUCacheShard cache line size alignment 216644c6 enable UBSAN macro in TARGETS e67b35c0 Add Iterator::Refresh() a34b2e38 Fix caching of compaction picker's next index 72502cf2 Revert "comment out unused parameters" 1d7048c5 comment out unused parameters 534c255c Cassandra compaction filter for purge expired columns and rows 63163a8c Remove make_new_version.sh 0302da47 Reduce blob db noisy logging 3e5ea29a Fix Flaky DeleteSchedulerTest::ImmediateDeleteOn25PercDBSize a22b9cc6 overlapping endpoint fixes in level compaction picker ffd2a2ee delete ExpandInputsToCleanCut failure log 3e6e863b Remove arcanist_util directory 36651d14 Moving static AdaptationContext to outside function 6e3ee015 Update java/rocksjni.pom ecff9d5e Include write_buffer_manager in ImmutableDBOptions::Dump ae28634e Remove some left-over BSD headers 33b1de82 Remove format compatibility hack 2f375154 checkout local branch in check_format_compatible.sh ddb22ac5 avoid collision with master branch in check format 0c03a7f1 set the remote for git checkout 7ac184c6 Revert cmake -DNDEBUG for non-MSVC 0655b585 enable PinnableSlice for RowCache 00464a31 Fix column_family_test with LITE build b2dd192f tools/write_stress.cc: Correct "1204" typos. cbaab304 table/block.h: change memset f1a056e0 CodeMod: Prefer ADD_FAILURE() over EXPECT_TRUE(false), et cetera 4a2e4891 Add back the LevelDB license file a7321fc9 Remove the licensing description in CONTRIBUTING.md 3c327ac2 Change RocksDB License 13201336 Make TARGETS file portable ccf5f08f Set CACHE_LINE_SIZE for s390, PPC, ARM64 67510eef db_crashtest.py: remove need for shell 4267eb00 Remove punit tests 5bfb67d9 Enable write rate limit for updaterandom benchmark 20a691d9 Update HISTORY to release 5.7 98d1a551 db_bench to by default verify checksum 26ce69b1 Update blob db to use ROCKS_LOG_* macro 43e4eef7 remove unnecessary fadvise 21b17d76 Fix BlobDB::Get which only get out the value offset 70440f7a Add virtual func IsDeleteRangeSupported 7550255c Add JAVAC_ARGS as Makefile variable 7a0b5de7 Gcc 7 ignored quantifiers 000bf0af Improve the design and native object management of Stats in RocksJava 269d383d Bump version to 5.7 c32f2722 Fixes db_bench with blob db fcd99d27 db_bench_tool: fix buffer size 87128bd5 fix regression test 8f927e5f Fix undefined behavior in Hash 643b787c Added a note about LZ4 compression dependency 56656e12 Temporarily disable FIFOCompactionWithTTLTest b5fb85ec fix valgrind init complaint 657df29e Add max_background_jobs to db_bench a43c053a remove duplicated utilities/merge_operators/cassandra/test_utils.cc in src.mk 7c4a9e6c Initialize a variable in ldb to make code analysis tool happy 98669b53 init filters_in_partition_ 0013bf14 fix asan and valgrind leak report in test 521b4c28 rocksdb 5.5.1 release post 33042573 Fix GetCurrentTime() initialization for valgrind f6b9d935 Fix clang error in PartitionedFilterBlockBuilder 45b9bb03 Cut filter partition based on metadata_block_size f4ae1bab update history for OnBackgroundError and DeleteRange fix 1cb8c6de Add -enable_pipelined_write to db_bench and add two defaults 7604b463 Update the AddDBStats in LITE 1e34d07e Simplify and document sync rules for logs_ etc d310e0f3 Regression test for empty dedicated range deletion file e9f91a51 Add a fetch_add variation to AddDBStats c1b375e9 skip generating empty sst 67b417d6 fix format compatible test afbef651 Bug fix: Fast CRC Support printing is not honest 397ab111 Improve Status message for block checksum mismatches 18c63af6 Make "make analyze" happy 01534db2 Fix the reported asan issues 1cd45cd1 FIFO Compaction with TTL 982cec22 Fix TARGETS file tests list b49b3710 allow numa >= 2.0.8 e517bfa2 CLANG Tidy dc3d2e4d update compatible test 89468c01 Fix Windows build broken by 5c97a7c0664d4071768113814e9ba71fe87e18cf 51778612 Encryption at rest support 7061912c Trivial typo in HISTORY.md 2a9cd879 Fix jni WriteBatchThreadedTest 0025a364 revert perf_context and io_stats to __thread 5c97a7c0 Unit Tests for sync, range sync and file close failures 4cee11f4 Intra-L0 blog post 857e9960 Improve the error message for I/O related errors. d757355c Fix bug that flush doesn't respond to fsync result 8e6345d2 Update rename of ParanoidCheck 499ebb3a Optimize for serial commits in 2PC 0ac4afb9 Sanitize partitioning options 521724ba fixed wrong type for "allow_compaction" parameter 71f5bcb7 Introduce OnBackgroundError callback 88cd2d96 Downgrade option sanitiy check level for prefix_extractor 6837a176 Fix Data Race Between CreateColumnFamily() and GetAggregatedIntProperty() af174675 WriteBufferManager will not trigger flush if much data is already being flushed 9467eb61 Fix flush assertion with tsan 048446fc Fix cassandra ASAN use-after-free a21db161 Implement ReopenWritibaleFile on Windows and other fixes c430d69e fix coredump for release nullptr 0d278456 default implementation for InRange cbd825de Create a MergeOperator for Cassandra Row Value 2c98b06b Remove pin_slice option by making it the default c80c6115 add db_bench options for partitioning 6a3377f4 Synchronize statistic enumeration values between statistics.h and java API 53dda879 Do not run RateLimiterTest.Rate test on Travis+Mac OSX. ae8571f5 Fix blob db compression bug 7a380def Update blob_db_test 89ad9f3a Allow ignoring unknown options when loading options from a file 6b5a5dc5 fixed typo 0f228be3 fixed typo in util/dynamic_bloom.h c217e0b9 Call RateLimiter for compaction reads 91e2aa3c write exact sequence number for each put in write batch 6f4154d6 record index partition properties 5d5a28a9 Fix Clang release build broken by 5582123dee8426a5191dfd5e846cea8c676c793c 0175d58c Make direct I/O write use incremental buffer 7a270069 GNU C library for struct tm has 2 additional fields. d713471d Limit trash directory to be 25% of total DB 9bb91e93 Dedup release 27b45016 Update HistogramTypes in the Java API e97304c6 update history for 5.6 5582123d Sample number of reads per SST file db818d2d Fix RocksDB Lite build with CLANG a472c4ae update 5.5 change log bc09c8a0 Fix crash in PosixWritableFile::Close() when fstat() fails 6d0f22e4 Fix mock_env.cc uninitialized variable c2012d48 Java APIs for put, merge and delete in file ingestion 85dace2a Disable DBRangeDelTest::TailingIteratorRangeTombstoneUnsupported for ubsan d4f7731b fix travis error with init time in mockenv 550a1df7 Fix clang errors by asserting the precondition cc5f9339 Fix concurrency issue with filter_block_set_ 2e64f450 bump version to 5.6 afbc2d0d Force travis to build with clang on MacOS b172a3f1 Fix warnings while generating RocksJava documentation 52a7f38b WriteOptions.low_pri which can throttle low pri writes if needed 26a8a807 Switch from CentOS 5 to CentOS 6 for crossbuilding RocksJava dba9f372 Fix db_write_test clang/windows build failure c7662a44 fixed typo 7e8d95cc Fix the Java build which was broken by a4d9c02 7e5fac2c remove test dir before exit when current regression is running 7f6c02dd using ThreadLocalPtr to hide ROCKSDB_SUPPORT_THREAD_LOCAL from public… 138b87ea Fix interaction between CompactionFilter::Decision::kRemoveAndSkipUnt… 95b0e89b Improve write buffer manager (and allow the size to be tracked in block cache) a4d9c025 Pass CF ID to MemTableRepFactory f68d88be Fix DBWriteTest::ReturnSequenceNumberMultiThreaded data race 215076ef Fix TSAN: avoid arena mode with range deletions 3a8a848a account for L0 size in estimated compaction bytes 0fae3f5d codemod: format TARGETS with buildifier [5/5] (D5092623) 87219960 add checkpoint support for single db in regression test 5a9b4d74 Retire memenv https://github.com/facebook/rocksdb/pull/2082 d6019651 sync internal/external TARGETS bbaba51b Add missing index type to C-API 292edfd5 travis: test with xcode8.3 (OS X 10.12) 0dc3040d db: avoid `#include`ing malloc and jemalloc simultaneously 9b3ed835 fix regression test 9c9909bf Support ingest file when range deletions exist ad19eb86 Fixing blob db sequence number handling 51ac91f5 Histogram of number of merge operands 345878a7 update blob_db_test cbc821c2 change regression rebuild to one level 103d0692 Avoid unsupported attributes when not building with UBSAN 5fd04566 travis: reduce the number of travis builders 2d05002b RocksDB 5.4.5 release blog post 7eca90f1 Update RocksDB blog authors d03c3449 update comment of GetNextFile f7bb1a00 support merge and delete in file ingestion c2c62ad4 Reorder variables of ReadOptions 7bb1f5d4 Increase of compaction threads should be logged at info level instead of a warning 6c456eca Clean zstd files 347e16f8 codemod: replace `headers = AutoHeaders.*` with `auto_headers` 0be636bf Fix db_bench build break with blob db 135ee6a3 fix tsan crash data race a99fb992 fix column_family_test asan f41bffb3 travis: clang-3.6 -> clang-4.0 e7612798 update buckifer/TARGETS bb01c188 Introduce max_background_jobs mutable option 5a253046 Fix the CMakeLists for RocksJava 41cbb727 options.delayed_write_rate use the rate of rate_limiter by default. 50680346 range sync should be enabled 02594b5f Fix build errors in blob_dump_tool with GCC 4.8 52d9e5f7 Fix column family seconds_up accounting 7d8207f1 Fix errors in clang-analyzer builds 85b8569a Fix release build on Linux 69ec8356 Allow SstFileWriter to use the rate limiter 6cc9aef1 New API for background work in single thread pool 9d0a07ed Fix rocksdb.estimate-num-keys DB property underflow 578fb0b1 Simple blob file dumper ac39d6be Core-local statistics 3e86c0f0 disable direct reads for log and manifest and add direct io to tests 15ba4d6c Address MS Visual Studio 2017 issue with autovector 88c818e4 Replace deprecated RocksDB#addFile with RocksDB#ingestExternalFile 228f49d2 Fix data races caught by tsan 4c9d2b10 remove #include port/port.h in public header file 07bdcb91 New WriteImpl to pipeline WAL/memtable write d746aead Suppress clang-analyzer false positive 217b866f column_family_test: EnvCounter::num_new_writable_file_ to be atomic 9f839a7f keep util/build_version.cc when make clean 7eecd40a add emacs tags file - etags 9bbba4fe Remoe unused BlockBasedTable::compaction_optimized_ f5ba131b Fixed some spelling mistakes 146b7718 Fix mingw compilation with -DNDEBUG a36220cc fix unity test 0ebdd705 fixed typo 8032f4cb Remove -pie in TSAN 362ba9b0 Release RocksDB 5.5.0 ba685a47 Support ingest_behind for IngestExternalFile 01ab7b52 Add ROCKSDB_LIBRARY_API macro to a few C APIs, to fix windows build cb9392a0 add Transactions and Checkpoint to C API 445f1235 s/std::snprintf/snprintf cd593c28 Fix travis java_test f720796e fixed typo a48a62d5 define NDEBUG in CMake non-debug builds 1ca723db C API: support pinnable get 2ef15b85 Core-local stats blog post 4f9e69cc fix log err 11c5d474 cross-platform compatibility improvements d0043330 Put lib files into suitable path in RPM package 86d54925 Fix build error with blob DB. 254c4680 Fix the RocksJava Release on Windows 7a47b431 Fix .gitignore pattern fa5a15ce Make sure that zstd is statically linked correctly in the Java static build 3fa9a39c Add GetAllKeyVersions API 1a60982a Simplified instructions for CentOS a5cc7ece Facility for cross-building RocksJava using Docker ccd3dddf Blog post for partitioned index/filters b145c34d Update blog authors bbe9ee7d core-local array type conversions c2be4343 Build and link with ZStd when creating the static RocksJava build c61e72c4 Add missing files of blob_db to CMake file 3907c94f Fix ColumnFamilyTest:BulkAddDrop cda5fde2 CoreLocalArray class 93949667 update TARGETS 4e83b800 title: Bulkoading -> title: Bulkloading d85ff495 Blob storage pr 492fc49a fix readampbitmap tests be421b0b portable sched_getcpu calls 0f559abd Add NO_UPDATE_BUILD_VERSION option to makefile 3a04a254 Flink state 35df23fe Fix suite exclisions e7cea86f Fixes the CentOS 5 cross-building of RocksJava 259a00ea unbiase readamp bitmap a6209669 port: updated PhysicalCoreID() df035b68 Print compaction_options_universal.stop_style in LOG file 4897eb25 dont skip IO for filter blocks 3f73d54b Add C API to set max_file_opening_threads option 0b69e507 Define CACHE_LINE_SIZE only when it's not defined 2cd00773 Add bulk create/drop column family API 40af2381 Object lifetime in cache fdaefa03 travis: add Windows cross-compilation a30a6960 do not read next datablock if upperbound is reached 2d42cf5e Roundup read bytes in ReadaheadRandomAccessFile 264d3f54 Allow IntraL0 compaction in FIFO Compaction 8c3a180e Set lower-bound on dynamic level sizes 7c1c8ce5 Avoid calling fallocate with UINT64_MAX a45e98a5 max_open_files dynamic set, follow up 6b99dbe0 fix memory alignment with logical sector size e7ae4a3a Max open files mutable 60847a3b port: updated PhysicalCoreID() b551104e support PopSavePoint for WriteBatch 498693cf Remove orphaned Java classes 5e2ebf2b travis: add CMake compilation af6fe69e Fix an issue of manual / auto compaction data race 6798d1f3 Revert "Delete filter before closing the table" 89833577 Delete filter before closing the table 47a09b0a Avoid pinning when row cache is accessed aeaba07b Remove an assert that causes TSAN failure. 0b90aa95 Set VALGRIND_VER a2b05210 Make PosixLogger::flush_pending_ atomic da4b2070 Fix WriteBatchWithIndex address use after scope error d616ebea Add GPLv2 as an alternative license. 4439b459 Add documentation license 0ca3ead0 add GetRootDB() in DeleteFilesInRange cdad04b0 Remove double buffering on RandomRead on Windows. e15382c0 Disable two flaky tests 2150cc1f fix WritableFile buffer size in direct IO efc361ef Add user stats Reset API 6616e4d6 add prefetch to PosixRandomAccessFile in buffered io f6a27d0b Extract statistics tests into separate file 7eddecce support bulk loading with universal compaction 3b4d1b7a add <sys/sysmacros.h> to avoid warning with glibc 2.25 e5e545a0 Reunite checkpoint and backup core logic 72c21fb3 call GetRootDB() before cast to DBImpl* in CancelAllBackgroundWork 4c9447d8 Add erase option to release cache 04d58970 AIX and Solaris Sparc Support afff9951 Respect deprecated flag in table options 066cfbac Adding -noprofile to CMakeLists for Windows cb885bcc set compaction_iterator earliest_snapshot to max if no snapshot 7534ba7b StackableDB should pass ResetStats() c1fbf91b Fixing Solaris Sparc crash due to cached TLS 963eeba4 Revert how check_format_compatible.sh checkout release branches. 97005dbd tools/check_format_compatible.sh to cover option file loading too 8f619678 Add cpu usage to regression benchmarks (4th attempt) df74b775 Limit backups opened 1dd77605 Change L0 compaction score using level size 927bbab2 Revert "Add cpu usage to regression benchmarks (3rd attempt)" 8e84a388 Re-add index_per_partition but as deprecated 1553659d Add more recent versions to tools/check_format_compatible.sh 966ebb02 Hide event listeners from lite build 476e80be Add cpu usage to regression benchmarks (3rd attempt) c49d7046 Add DB:ResetStats() 0fcdccc3 Blob storage helper methods a6439d79 CMake: compile with -O2 e67f0adf enable O2 optimization for lz4 bc397325 CMake: add support for SSE4.2 7d5f5aa9 Separate compile and link for shared library 07165273 remove warning 6e8d6f42 readahead backwards from sst end ca96654d Change Build Env to gcc-5 e9e6e532 Simplify write thread logic 6799c7e0 Pass in remote as a param to branch creation script 44fa8ece change use_direct_writes to use_direct_io_for_flush_and_compaction 13b50358 add space for buggy kernel warning b6b9359e Fix BYTES_WRITTEN accounting 13369fbd Update ShipIt to honor TARGETS updates f2449ce9 Remove .deprecated_arcconfig 415be221 RocksDB Release 5.4 : Update HISTORY.md and build version. 3eab41d7 java dependencies test -s -> use test -d a22ed4ea internal_repo_rocksdb to build Java and RocksDB LITE 9f2cc59e sync TARGETS file 10d75469 set readahead buffer size from roundup(user_size) + 4k to roundup(use… ba7da434 fix db_stress crash caused by buggy kernel warning 6257837d Add ROCKSDB_JAVA_NO_COMPRESSION flag 6a6723ee Move MergeOperatorPinning tests to be with other merge operator tests 6a8d5c01 Revert "Report cpu usage using time command" 8f47a975 File level histogram should be printed per CF, not per DB 9300ef54 Fix shared lock upgrades 1f8b119e Limit maximum memory used in the WriteBatch representation 97ec8a13 Report cpu usage using time command 20778f2f Adding comments to the write path 7124268a Reduce the number of params needed to construct DBIter 04abb2b2 FreeBSD only requires WITH_JEMALLOC, not the rest 61730186 dummy diff 360e9960 Summary: Remove .arcconfig 69a5e646 Deprecate .arcconfig 9690653d Add a verify phase to benchmarks dd8f9e38 Fix compilation for GCC-5 c2954f9b Add Travis job to build examples 72fc1e9d avoid non-existent O_DIRECT on OpenBSD ff972870 Refactor compaction picker code 9e729390 only FALLOC_FL_PUNCH_HOLE when ftruncate is buggy 343b59d6 Move various string utility functions into string_util 1d068f60 Fix CompactRange incorrect buffer release df6f5a37 Move memtable related files into memtable directory 107c5f6a CMake: more MinGW fixes d2dce561 Move some files under util/ to separate dirs c50e3750 Use a human readable size for level report ce64b8b7 Divide db/db_impl.cc 02799ad7 Revert "delete fallocate with punch_hole" e2a7b202 Release note for partition filters af256eb2 build db every monday e5a1372b Rework test running script. d659faad Level-based L0->L0 compaction a12306fa Add a notice on gflags installation in INSTALL.md 43010a92 Revert "[rocksdb][PR] CMake: more MinGW fixes" a30b75cd Add buckifier script to github repo 3450ac8c CMake: more MinGW fixes 90cfd464 update IterKey that can get user key and internal key explicitly e2c6c063 add TimedEnv 9e445318 Refactor WriteImpl (pipeline write part 1) 6ef8c620 Move auto_roll_logger and filename out of db/ a1c469d7 Add release notes for PinnableSlice 0537f515 fix run_remote with strong quoting 72e60009 fixed misses on Centos library installation instructions 88cc81df auto_roll_logger_test to move away from real sleep d25e28d5 replace sometimes-undefined uint type with unsigned int a1d7e487 Add L0 write-amp to compaction level stats b6d60906 CMake: support AVX2 in MinGW bd7d1383 test remote instead run remote in regression test c81a805f test db existence on the remote host 5fc1e676 add -rf when remove db in regression test 4ab4049f gflags has moved to GitHub 4e006501 make all DB::Get overloads virtual 6401a8b7 Fix build with MinGW 80fe5b38 disable test: DeleteSchedulerTest.DynamicRateLimiting1 a9c86f51 backup garbage collect shared_checksum tmp files da175f7e exit with code 2 when there is already a db_bench running in regression test 0ee7f040 Added missing options to RocksJava c6d04f2e Option to fail a request as incomplete when skipping too many internal keys 58179ec4 Cleanup of ThreadStatusUtil structures should use the DB's reference f3607640 add ldb build to regression test 8a8c9674 Enable Fast CRC32 for Win64 f9813b85 Added SstFileWriter construtor without explicit comparator to JNI api 8d3cb4f2 Added naming of backup engine threads 67d76237 Expose the stalling information through DB::GetProperty() 0fd57492 delete fallocate with punch_hole 41fe9ad7 Hide usage of compaction_options_fifo from lite build e7731d11 Configure index partition size 69c8d524 Fix jni library name for PowerPC Architecture 34a70859 Fix segmentation fault caused by #1961 8dee8cad Enable fifo compaction benchmark to db_bench a5c8b543 fix a header include 91b5feb3 Fix Windows Build broken by a recent commit 41ccae6d Add C API functions (and tests) for WriteBatchWithIndex 88bb6f6b non_shm CI should run tests on /tmp 8888de2b Update .gitignore file in examples 203136e7 Fix Compilation errors when using IBM Java f4fce475 Fix clang compile error - [-Werror,-Wunused-lambda-capture] a084b26a Blog post for releasing 5.2.1 15950fe3 Remove ASSERT_EQ(boolean, ...) 3e56c7e0 make total_log_size_ atomic 909028e2 HISTORY.md for log_size_for_flush in CreateCheckpoint() be723a8d Optionally construct Post Processing Info map in MemTableInserter e474df94 db_bench: not need to check mmap for PlainTable 8b0097b4 Readers for partition filter 9ef3627f Allow checkpointing without flushing 17866ecc Allow Users to change customized ldb tools' header in help printing a2a88331 remove deleted option from benchmark.sh 78cb1955 add checkpoint to ldb 4b04addf updated solution if "make format" command fails 8f5bf044 Flush triggered by DB write buffer size picks the oldest unflushed CF 6908e24b dynamic setting of stats_dump_period_sec through SetDBOption() 93c68b64 change regression bash file with debug mode 21d8c317 remove LIKELY from public headers 36ad7577 INSTALL: document USE_SSE 9272e12f avoid ftruncate twice in buffered io d52f334c Break stalls when no bg work is happening e66221ad fix db_bench rate limiter callsites dbae438a Replace "DEPRECATED" comment to "not supported" 995618a8 Support SstFileManager::SetDeleteRateBytesPerSecond() e1916368 Add macros to include file name and line number during Logging d525718a cleanup direct io flag in WritableFileWriter 5fa927aa Add Xpress and ZSTD CompressionType values to C header 11526252 Pinnableslice (2nd attempt) e5bd8def update history.md for fixing the bug that skips keys 1ffbdfd9 Add a new SstFileWriter constructor without explicit comparator ebd5639b Add ability to search for key prefix in sst_dump tool e6725e8c Fix some bugs in MockEnv 900c62be fix compile for VS2015 fe183561 release 5.3 5dae0194 Revert "Report cpu usage using time command" f2817fb7 avoid ASSERT_EQ(false, ...); 5b11124e add max to histogram stats d43adf21 Report cpu usage using time command 18fc1bc0 minor changes for rate limiter test flakiness 12ba00ea Reset DBIter::saved_key_ with proper user key anywhere before pass to DBIter::FindNextUserEntry c9df05d1 Fix random access alignment f6499153 Add Bulkoading IngestExternalFile blog post 54b43411 Builders for partition filter 97edc72d Add a memtable-only iterator 72202962 fix db_sst_test flakiness 5f65dc87 Expose DB::DeleteRange and WriteBath::DeleteRange in Java 58b12dfe Set logs as getting flushed before releasing lock, race condition fix f8a4ea02 Move db_test and external_sst_file_test out of Travis's MAC OS run 534581a3 Fix a bug in tests in options operator= a2f7a514 Refactoring 2a5daa06 Add stderr log level for ldb backup commands 4561275c fix rate limiter test flakiness 7c80a6d7 Statistic for how often rate limiter is drained 0ad5af42 Clarify VerifyBackup behavior 6fb90134 sanitize readahead when direct read enabled f89b3893 Remove skip_table_builder_flush and default it to true cc253982 Use more default options in db_bench 8432bcf5 Make compaction_pri settable through option string d5b607a4 Make db_wal_test slightly faster ba4c77bd Divide external_sst_file_test e877afa0 Remove bulk loading and auto_roll_logger in rocksdb_lite 90d83550 Fix the wrong address for PREFETCH in DynamicBloom::Prefetch 08864df2 Move advanced column family options to advanced_options.h 2ca2059f Get unique_ptr to use delete[] for char[] in DumpMallocStats 253799c0 Add missing include for `abort()` c6d464a9 Fixed various memory leaks and Java 8 JNI Compatibility be3e5568 Fix unaligned reads in read cache 8ad0fcdf Separate small subset tests in DBTest 6c951c43 Run fewer tests in OSX f7997f13 add direct I/O to version notes 5.2.0 3b8ba703 Fix flaky DBTestUniversalCompaction.UniversalCompactionTrivialMoveTest2 96c7e150 Fix Java build e0b87afc Black list some slow valgrind tests e67232cf Handle failed Finish() in SST file writer 8efb5ffa [rocksdb][PR] Remove option min_partial_merge_operands and verify_checksums_in_comp… 1ba2804b Remove XFunc tests e7d902e6 add direct_io and compaction_readahead_size in db_stress 1ef5f50e detect logical sector size ed50308d check backup directory exists before listing children 4d7c06ce Make WriteBatchWithIndex moveble 5040414e Gracefully handle previous backup interrupted f206af56 add use_direct_io() to ReadaheadRandomAccessFile 08249344 truncate patch 286a36db posix writablefile truncate f0879e4c Page size isn't always 4k on linux 18eeb7b9 Fix interference between max_total_wal_size and db_write_buffer_size checks 1560b2f5 Temporarly return deprecated functions to fix MongoRocks build 2a0f3d0d level compaction expansion ebc8a799 alignment is on in ReadaheadRandomAccessFile::Read() 381fd322 Remove timeout_hint_us from WriteOptions fce7a6e1 Fail IngestExternalFile when bg_error_ exists a618a16f New subcode for IOError to detect the ESTALE errno 7ab00518 Remove deprecated DB::AddFile and DB::CompactRange 40166736 Adding Dlang to the list 756c5924 Allow adding external v1 sst file with no global seqno support aa0298fa Remove trailing whitespace from examples Makefile db2b4eb5 avoid direct io in rocksdb_lite 43e9f01c Fix repair_test on ROCKSDB_LITE 7106a994 Use monotonic time points in write_controller.cc and rate_limiter.cc c2247dc1 Make DBImpl::has_unpersisted_data_ atomic eb912a92 Remove disableDataSync option 0227c16d Update static library versions and add checksums b3aae4d0 Add repair_test to make check 421ce7c2 Add support for JNI Library on Linux on PowerPC. 9afa20cf Increase build version and HISTORY.md for releasing 5.2 a5adda06 Fix repair issues b48e4778 Consolidate file cutting logic in compaction loop ac2a77a7 Announce the experimetnal two-level index feature in HISTORY.md c4a37dcb Print the missed last layer in cfstats a12818af Blog post for 5.1.2 release 3b4ac807 Clarify ldb column family argument d70ce7ee Move db_bench flags out of unnamed namespace 186c7eed Remove incorrect statistics warning 53bb0151 [rocksdb][PR] compaction_style and compaction_pri should output their value as a st… 69d5262c Two-level Indexes 0a4cdde5 Windows thread 1aaa898c Adding GetApproximateMemTableStats method 9fc23c55 Use gcc-4.9-glibc-2.20-fb python in precommit_checker b797e421 Dump compression dictionary meta-block 036d668b Fix wrong result in data race case related to Get() 574b543f Rename merger.h -> merging_iterator.h add8b50c Move ThreadLocal implementation into .cc 71d2496a Fix arc setting for Facebook internal tools f289d9f4 Fix OSX build break after the fallocate change 4a3e7d32 Change the default of delayed slowdown value to 16MB/s 0513e21f RangeSync() should work with ROCKSDB_FALLOCATE_PRESENT not set 8b369ae5 Cleaner default options using C++11 in-class init ec79a7b5 Dedup code in option.cc and db_options.cc b96372de improving the C wrapper 04c4ec41 Change corruption_test to use 4 bits. 2d75cd40 NewLRUCache() to pick number of shard bits based on capacity if not given f25f1ec6 Add test DBTest2.GetRaceFlush which can expose a data race bug 37d4a79e Deserialize custom Statistics object in db_bench 3b35134e Avoid cache lookups for range deletion meta-block 94a0c32e Fix LRU Ref() for handles with external references only 17c11806 Generalize Env registration framework 07dddd5f EnvPosixTestWithParam should wait for all threads to finish 5dad9d6d Avoid logs_ operation out of DB mutex a7b13919 Fix CompactFiles() bug when used with CompactionFilter using SuperVersion 616a1464 Fix DeleteRange including sentinels in output files c918c4b7 Update USERS.md add user Pika 03ca2ac8 Remove function from DBImpl that are not used anywhere b0029bc7 Test merge op covered by range deletion in memtable d438e1ec Test range deletion block outlives table reader fba726e5 Version librocksdb.so 9da4d542 Range deletions unsupported in tailing iterator f2b4939d fixed typo 973f1b78 memtable: delete merge value for range deleteion aebfd170 fix non-portable behavior in encoder 753ff84a Fix get approx size d7ea44f2 Fixup a couple of builds errors on Linux. 537da370 c: allow set savepoint to writebatch af6ec4d7 fix batchresult handle leak e29bb934 Zlib 1.2.8 is no longer available, switched to 1.2.10 5ac97314 Fix std::out_of_range when DBOptions::keep_log_file_num is zero 4e35ffdf cmake: check -momit-leaf-frame-pointer before using it 3c0852d1 Make ingest external file backward compatible 0e8dfd60 Fix OptimizeForPointLookup() e840213d Change DB::GetApproximateSizes for more flexibility needed for MyRocks 9239103c Flush job should release reference current version if sync log failed da54d36a Disable IngestExternalFile in ReadOnly mode 5cf176ca Fix for 2PC causing WAL to grow too large 4a73bb0b Split travis jobs c70d3c7a Enable DBTest.GroupCommit as it runs in a reasonlable time now. 602c13a9 Remove fadvise with direct IO read f9d18e22 Fix DeleteRange file boundary correctness issue with max_compaction_bytes 3ce091fd Add KEEP_DB env var option 77b48066 Fix 2PC with concurrent memtable insert e8a09600 util/thread_local.h: silence a clang-build warning 324a0f98 Follow up for DirectIO refactor bc5d7b70 travis: For linux, do all tests under gcc 3e6899d1 change UseDirectIO() to use_direct_io() d4e07a84 fix warning of unused direct io helper functions dc2584ee direct reads refactor d18dd2c4 Abort compactions more reliably when closing DB 62384ebe Guarding extra fallocate call with TRAVIS because its not working pro… 9f246298 Performance: Iterate vector by reference fe395fb6 Allow incrementing refcount on cache handles 2172b660 Fix build on FreeBSD 3c233ca4 Fix Windows environment issues 76317345 Fix the error in ColumnFamiliesTest 7a02ad07 Update travis to ubuntu trusty 60c509ff Fix valgrind failure in test CurrentFileModifiedWhileCheckpointing2PC d0ba8ec8 Revert "PinnableSlice" 54d94e9c PinnableSlice e04480fa Fix MS warnings. Use ROCKSDB_Prsz for size_t. c081f721 5.0.1 release blog post ac73d755 Add GetSupportedCompressions() convenience function b104b878 Maintain position in range deletions map 640d7248 Update db_bench and sst_dump to test with block cache mid-point inser? 653ac1f9 C API: support total_order_mode 85ac1a32 Fix rocksdb::Status::getState 76711b6e Make ExternalSSTFileTest::CompactionDeadlock more deterministic c963460d Fix tests under GCC_481 33c86d67 Fix backupable db test e425ec11 utilities/backupable: backup should limit the copy size of wal. 0712d541 Delegate Cleanables d58ef52b Allow SstFileWriter to Fadvise the file away from page cache 17a4b75c Always fsync the file after file copying 2fb70dc7 examples: Add options_file_example to target all a738af8f db/pinned_iterators_manager.h: bugfix 906523d9 Add description to the 2PC checkpooint bug in HISTORY.md 438f22bc Fix bug of Checkpoint loses recent transactions with 2PC 335981d4 Fix the directory path for RocksDB repo 548b6280 Enable conditionally using adaptive mutexes 4e07b08e include/rocksdb/utilities/env_librados: fix typo ab48c165 Print cache options to info log 972f96b3 direct io write support 989e644e Remove sst_file_manager option from LITE 1beef656 Fix c_test 3d692822 persistent_cache: fix two timer 046099c9 The array is malloced by backtrace_symbols(), and must be freed 6ff2c8d7 Remove gflags as travis build dependency 3cd9ed1c Show sandcastle URL in phabricator 50e305de Collapse range deletions 5d1457db Dump persistent cache options 7bd725e9 db_bench: introduce --benchmark_read_rate_limit 29669184 Update Netflix section of USERS.md 342370f1 Simplify MemTable::Update 1a136c1f Expose file size fbff4628 Reduce compaction iterator status checks bd6cf7b5 WritableFileWriter: default buffer size equal min(64k,options.writabl? fc0c6fd9 "make format" format diff since last commit from master 816c1e30 gcc-7 requires include <functional> for std::function c2707358 Iterator should be in corrupted status if merge operator return false a8bf4d63 Make format shows wrong curl command for retrieving clang-format-diff.py 8f5d24ae C API: support get usage and pinned_usage for cache 0ab6fc16 Gcc-7 buffer size insufficient b7239bf7 Gcc 7 fallthrough 477b6ea5 std::remove_if requires <algorithm> 83f9a6fd Fail BackupEngine::Open upon meta-file read error a79eae4b Add pcache documentation images d71e728c Print user collected properties in sst_dump 7004a6f7 Add missing copyright header 3cdfaeca Fixes for MSVC compilation e097222e util/logging.cc: buffer of insufficient size (gcc-7 -Werror=format-length) cfc34d7c Missing break in case in DBTestBase::CurrentOptions bfbcec23 Gcc 7 error expansion to defined 6653e32a build: make it easier to pass PORTABLE 67adc937 intentional fallthough (prevents gcc-7/clang-4 error) 1a146f89 break Flush wait for dropped CF c3e5ee71 util/histogram.cc: HistogramStat::toString buffer insufficient 5334d8b4 table/block_based_table_builder.cc: intentional fallthrough - comment to match gcc pattern 36d42e65 Disable test to unblock travis build b57dd926 C API: support writebatch delete range 2ba59b5a Disallow ingesting files into dropped CFs 1f6f7e3e cast to signed char in ldb_cmd_test for ppc64le 243975d5 More accurate error status for BackupEngine::Open f0c509e2 Return finer-granularity status from Env::GetChildren* dc64f46b Add db_bench option for stderr logging 2cabdb8f Increase buffer size 4a17b47b Remove unnecessary header include 8c2b921f Fixed a crash in debug build in flush_job.cc 20ce081f Fix issue where IngestExternalFile insert blocks in block cache with g_seqno=0 5241e0db fix db_bench argument type c04f6a0b Specify shell in makefile 45c7ce13 CompactRangeOptions C API 2c2ba682 db_stress support for range deletions b821984d DeleteRange read path end-to-end tests 2f4fc539 Compaction::IsTrivialMove relaxing 1dce75b2 Update USERS.md 304b3c70 Update USERS.md fa50fffa Option to expand range tombstones in db_bench c26a4d8e Fix compile error in trasaction_lock_mgr.cc ed8fbdb5 Add EventListener::OnExternalFileIngested() event 2005c88a Implement non-exclusive locks 0b0f2357 Mention IngestExternalFile changes in HISTORY.md 23db48e8 Update HISTORY.md for 5.0 branch beb36d9c Fixed CompactionFilter::Decision::kRemoveAndSkipUntil 67f37cf1 Allow user to specify a CF for SST files generated by SstFileWriter 9053fe2a Made delete_obsolete_files_period_micros option dynamic edde954e fix clang build 56281f3a Add memtable_insert_with_hint_prefix_size option to db_bench 4a21b140 Cache heap::downheap() root comparison (optimize heap cmp call) e39d0808 Fix travis (compile for clang < 3.9) 3f407b06 Kill flashcache code in RocksDB b77007df Bug: paralle_group status updated in WriteThread::CompleteParallelWorker 247d0979 Support for range skips in compaction filter 96fcefbf c api: expose option for dynamic level size target 00197cff Add C API to set base_backgroud_compactions 5b219ecc deleterange end-to-end test improvements for lite/robustness aad11917 pass rocksdb oncall to mysql_mtr_filter otherwise tasks get created w… e3335289 DeleteRange write path end-to-end tests 7784980f Fix mis-reporting of compaction read bytes to the base level 3c6b49ed Fix implicit conversion between int64_t to int b3b87565 Remove unused assignment in db/db_iter.cc 4f6e89b1 Fix range deletion covering key in same SST file a2bf265a Avoid intentional overflow in GetL0ThresholdSpeedupCompaction 52fd1ff2 disable UBSAN for functions with intentional -ve shift / overflow 1886c435 Fix CompactionJob::Install division by zero 63c30de8 fix options_test ubsan 13e66a8f Fix compaction_job.cc division by zero 01eabf73 Fix double-counted deletion stat 7ffb10fc DeleteRange compaction statistics 236d4c67 Less linear search in DBIter::Seek() when keys are overwritten a lot cd7c4143 Improve Write Stalling System dfb6fe67 Unified InlineSkipList::Insert algorithm with hinting 3068870c Making persistent cache more resilient to filesystem failures 734e4aca Eliminate redundant cache lookup with range deletion 182b940e Add WriteOptions.no_slowdown 4118e133 Persistent Cache: Expose stats to user via public API f2a8f92a rocks_lua_compaction_filter: add unused attribute to a variable 4444256a Remove use of deprecated LZ4 function 548d7fb2 Fix fd leak when using direct IOs fd43ee09 Range deletion microoptimizations 23a18ca5 Reword support a little bit to more clear and concise 481856ac Update support to separate code issues with general questions a0deec96 Fix deadlock when calling getMergedHistogram fe349db5 Remove Arena in RangeDelAggregator e63350e7 Use more efficient hash map for deadlock detection a13bde39 Skip ldb test in Travis 73843aa6 Direct I/O Reads Handle the last sector correctly. 9d60151b Implement PositionedAppend for PosixWritableFile 3f622152 Lazily initialize RangeDelAggregator's map and pinning manager 41e77b83 cmake: s/STEQUAL/STREQUAL/ c1038d28 Release RocksDB 5.0 635a7bd1 refactor TableCache Get/NewIterator for single exit points f39452e8 Fix heap use after free ASAN/Valgrind a4eb7387 Allow plain table to store index on file with bloom filter disabled 36e4762c Remove Ticker::SEQUENCE_NUMBER 86eb2b9a Fix src.mk 0765babe Remove LATEST_BACKUP file 647eafdc Introduce Lua Extension: RocksLuaCompactionFilter 760ef68a fix deleterange asan issue 327085b7 fix valgrind 715591bb Ask travis to use JDK 7 972e3ff2 Enable allow_concurrent_memtable_write and enable_write_thread_adaptive_yield by default 420bdb42 option_change_migration_test: force full compaction when needed 1543d5d9 Report memory usage by memtable insert hints map. 018bb2eb DeleteRange support for db_bench dc51bd71 CMakeLists.txt: FreeBSD has jemalloc as default malloc 48e8baeb Decouple data iterator and range deletion iterator in TableCache 4b0aa3c4 Fix failed compaction_filter_example and add it into make all 53b693f5 ldb support for range delete 661e4c92 DeleteRange unsupported in non-block-based tables 489d1428 DeleteRange interface eba99c28 Fix min_write_buffer_number_to_merge = 0 bug 2ef92fea Remove all instances of relative_url until GitHub pages problem is fixed. 91300d01 Dynamic max_total_wal_size option ec2f6479 Consider subcompaction boundaries when updating file boundaries for range deletion 800e5155 Fix CSS issues again b952c898 Parallize persistent_cache_test and transaction_test 3b192f61 Handle full final subcompaction output file with range deletions 6c579520 Make range deletion inclusive-exclusive 425210cc CSS issues are arising on the Github Pages side. Temp fix. 1ea79a78 Optimize sequential insert into memtable - Part 1: Interface df5eeb85 Optimize sequential insert into memtable - Part 2: Implementation 5ed65085 Fix SstFileWriter destructor adb665e0 Allowed delayed_write_rate option to be dynamically set. 307a4e80 sst_dump support for range deletion 361010d4 Exporting compaction stats in the form of a map 672300f4 Use relative Urls for stylesheets b39b2ee1 do not call get() in recovery mode 1ca5f6d1 Fix 2PC Recovery SeqId Miscount e095d0cb Rocksdb contruns to new Sandcastle API 14c0380e Convenience option to parse an internal key on command line c90fef88 fix open failure with empty wal 4e20c5da Store internal keys in TombstoneMap a9fb346e Fix RocksDB Lite build failure in c_test.cc d133b08f Use correct sequence number when creating memtable 144cdb8f 16384 as e.g .value for compression_max_dict_bytes 9bd191d2 Fix deadlock between (WriterThread/Compaction/IngestExternalFile) a9fae0a9 CSS problems again :( 193221e0 Fix Forward Iterator Seek()/SeekToFirst() e48f3f8b remove tabs and duplicate #include in c api 85bd8f51 Minor fix to GFLAGS usage in persistent cache a7875272 c: support seek_for_prev 0f17f927 Make the header links a bit more flexible cf19f559 single quotes in feed 2dc019e0 Fix header links f1aedda0 More Jekyll 3.3 fixes c54cdc37 More Jekyll 3.3 updates 2bcaf824 Update product and feature template for Jekyll 3.3 24bceb09 Java API - Implement GetFromBatch and GetFromBatchAndDB in WBWI 815f54af Insert range deletion meta-block into block cache 9e7cf346 DeleteRange user iterator support 5c5d01ae Fix wrong comment (Maximum supported block size) f998c979 DeleteRange Get support 879f3663 Add C api for RateLimiter 557034f3 Remove all instances of baseurl 437942e4 Add avoid_flush_during_shutdown DB option 2b16d664 Change max_bytes_for_level_multiplier to double 16fb0443 expose IngestExternalFile to c abi ce22ea99 Fix casts for MSVC 196af035 Introduce FAIL_ON_WARNINGS CMake variable (default ON) 40a2e406 DeleteRange flush support d5555d95 Fix MSVC compile error in 32 bit compilation da61f348 Print compression and Fast CRC support info as Header level f9eb5679 db_bench: --dump_malloc_stats takes no effect 6a4faee5 fix freebsd build include path err and so & jar file name c90c48d3 Show More DB Stats in info logs 1b295ac8 DBTest.GetThreadStatus: Wait for test results for longer 25f5742f Update documentation to point at gcc 4.8 b50a81a2 Add a test for tailing_iterator 04751d53 L0 compression should follow options.compression_per_level if not empty 2946cadc Improve RangeDelAggregator documentation 0a9fd05c Update Vagrant file (test internal phabricator workflow) fcd1e0bf Make rocksdb work with internal repo 0aab5e55 FreeBSD: malloc_usable_size is in <malloc_np.h> (#1428) 9c0bb7f1 cmake: drop "-march=native" from CXX_FLAGS (#1429) eeb27e1b Add handy option to turn on direct I/O in db_bench (#1424) c6168d13 removed some declarations from c.h which resulted in undefined symbols (#1407) bc429de4 revert fractional cascading in farward iterator b9bc7a2a Use skiplist rep for range tombstone memtable 60a2bbba Makefile: generate util/build_version.cc from .in file (#1384) 9ee84067 Disable DBTest.RepeatedWritesToSameKey (#1420) f41df304 OptionChangeMigration() to support FIFO compaction 2e8004e6 Changing the legocastle run to use valgrind_test instead of _check 9de2f752 revert Prev() in MergingIterator to use previous code in non-prefix-seek mode 24495186 DBSSTTest.RateLimitedDelete: not to use real clock 1168cb81 Fix a bug that may cause a deleted row to appear again 99c052a3 Fix integer overflow in GetL0ThresholdSpeedupCompaction (#1378) f83cd64c Fix a bug that mistakenly disable regression_test.sh to update commit (#1415) 0e926b84 Passing DISABLE_JEMALLOC=1 to valgrind_check if run locally 4dfaa661 Make IsDeadlockDetect() virtual member of Transaction 59a7c033 Change ioptions to store user_comparator, fix bug 869ae5d7 Support IngestExternalFile (remove AddFile restrictions) 1d9dbef6 Restrict running condition of UniversalCompactionTrivialMoveTest2 4edd39fd Implement deadlock detection 48fd619a Minor fixes to RocksJava Native Library initialization (#1287) 48e4e842 Disable auto compactions in memory_test and re-enable the test (#1408) fb2e4129 column_family_test: disable some tests in LITE 5af651db fix data race in compact_files_test a0ba0aa8 Fix uninitialized variable gcc error for MyRocks b88f8e87 Support SST files with Global sequence numbers [reland] 08616b49 [db_bench] add filldeterministic (Universal+level compaction) 52c9808c not split file in compaciton on level 0 5e0d6b4c fix db_stress assertion failure ab539983 Bump RocksDB version to 4.13 (#1405) b4d07123 SamePrefixTest.InDomainTest to clear the test directory before testing aa09d033 Avoid calling GetDBOptions() inside GetFromBatchAndDB() 6fbe96ba Compaction Support for Range Deletion 257de78d Remove "-Xcheck:jni" from Java tests (#1402) d88dff4e add seeforprev in history 5027dd17 Fix a minor bug in the ldb tool that was not selecting the specified (#1399) fea6fdd6 Fix @see in two Java functions (#1396) b1031d6c Remove function local statics that interfere with memory pooling (#1392) f4705401 Handle WAL deletion when using avoid_flush_during_recovery e29d3b67 Make max_background_compactions and base_background_compactions dynamic changeable 21e8dace fix assertion failure in Prev() b9311aa6 Implement WinRandomRW file and improve code reuse (#1388) a249a0b7 check_format_compatible.sh to use some branch which allows to run with GCC 4.8 (#1393) 040328a3 Remove an assertion for single-delete in MergeHelper::MergeUntil 8cbe3e10 Relax the acceptable bias RateLimiterTest::Rate test be 25% f26a139d Log successful AddFile 5691a1d8 Fix compaction conflict with running compaction 017de666 fixup commit 1b7af5fb Redo handling of recycled logs in full purge 27bfe327 Editorial change to README.md 89cc404d A bit of doc restructuring 9e7fda82 Fix arcanist 2e4b5cab Add missing RateLimiter class to the Windows build (#1382) ce4963fd [doc] Document that Visual Studio 2015+ is now required for Windows builds (#1389) e4892709 Fix scoped arena iterator (#1387) f8d8cf53 Fix log_write_bench -bytes_per_sync option. (#1375) 02b3e398 Make txn->GetState() const 447f1712 new Prev() prefix support using SeekForPrev() 991b585e More block cache tickers d6ae6dec Add Statistics::getAndResetTickerCount(). aea3ce4c Avoid string CONCAT which is not supported in cmake 2.6 (#1383) 2ad68b97 Support running consistency checks in release mode 67501cfc Fix -ve std::string::resize 04b02dd1 Testing asset links after config change 8c55bb87 Make Lock Info test multiple column families d0623289 Revert "Support SST files with Global sequence numbers" 5cd28833 [RocksJava] Adjusted RateLimiter to 3.10.0 (#1368) 37737c3a Expose Transaction State Publicly 2c1f9529 Add facility to write only a portion of WriteBatch to WAL 043cb62d Fix record_size in log_write_bench, swap args to std::string::assign. (#1373) 4985f60f env_mirror: fix a few leaks (#1363) 5aded67d update of c.h (#1371) 912aec13 "Recent Posts" -> "All Posts" 7cbb298d Make sure that when contribtuing we call out creating appropriate directories a06ad471 Add top level doc information to CONTRIBUTING.md 3fdd5b97 A little more generic CONTRIBUTING.md ed4fc31d Add link to CONTRIBUTING.md to main docs README.md e4922e18 Forgot to truncate one blog post 6d8cd7ed Add CONTRIBUTING.md for rocksdb.org contribution guidance bd55e5a1 Fix some formatting of compaction blog post 0f60358b CRLF -> LF mod (including removing trailing whitespace for those files) b90e29c9 Truncate posts on the main /blog/ page 0d7acada Add author fields to blog posts 01be4418 Add GitHub link to the landing page header 9d6c9613 Fix Mac build ab01da54 Support SST files with Global sequence numbers d346ba24 Minor fixes around Windows 64 Java Artifacts (#1366) e91b4d0c Add factory method for creating persistent cache that is accessible from public be1f1092 Expose transaction id, lock state information and transaction wait information 6009c473 Store range tombstones in memtable 3c21c64c Use size hint for HashMap in multiGet. Similar to https://github.com/facebook/rocksdb/pull/1344 (#1367) 13f7a01f Fixing JNI release build for gcc (#975) 7260662b Add Java API for SstFileWriter 26388247 delete unused variable for PrevInterval() 87dfc1d2 Fix conflict between AddFile() and CompactRange() eb44ed65 Update 2016-09-28-rocksdb-4-11-2-released.markdown e4437610 Update 2016-09-28-rocksdb-4-11-2-released.markdown 501f0510 Update 2016-09-28-rocksdb-4-11-2-released.markdown dec9009f Update 2016-09-28-rocksdb-4-11-2-released.markdown 4ed69dd0 Create 2016-09-28-rocksdb-4-11-2-released.markdown 21f4bb5a cmake support for linux and osx (#1358) 4defe306 fix typo in comments (#1360) f517d9dd Add SeekForPrev() to Iterator eb3894cf Recompute compaction score on SetOptions (#1346) 5c64fb67 Fix AddFile() conflict with compaction output [WaitForAddFile()] 9e9f5a0b Fix CompactFilesTest.ObsoleteFiles timeout (#1353) c2a62a4c not cut compaction output when compact to level 0 9ed928e7 Split DBOptions into ImmutableDBOptions and MutableDBOptions 4bc8c88e Recover same sequence id from WAL (#1350) 0a1bd9c5 add cfh deletion started listener da5a9a65 Fix mac build d45eb6c6 Fix typo (#1349) abc0ae46 Add AddFile() InternalStats for Total files/L0 files/total keys ingested 71525633 forbid merge during recovery 5735b3dc Fix compiling under -Werror=missing-field-initializers 654ed9a2 loose the assertion condition of rate_limiter_test e4d3f5d9 Fix DBImpl::GetWalPreallocateBlockSize Mac build error 7afbb742 solve the problem of table_factory_to_write_=nullptr (#1342) d78a4401 DBImpl::GetWalPreallocateBlockSize() should return size_t 42ac9c5f Retry getting arcanist token on failure b666f854 Consider more factors when determining preallocation size of WAL files 4c3f4496 Add TableBuilderOptions::level and relevant changes (#1335) 3edb9461 Avoid hard-coded sleep in EnvPosixTestWithParam.TwoPools 0a88f38b Remove ColumnFamilyData::options() 41a9070f Fix java makefile dependencies 8d9bf5c4 Fix DBOptionsTest.GetLatestOptions 40cfa3e0 Fix DBWALTest.RecoveryWithLogDataForSomeCFs with mac 06b4785f Fix recovery for WALs without data for all CFs d7242ff4 Fix GetSortedWalFiles when log recycling enabled 17f76fc5 DB::GetOptions() reflect dynamic changed options 215d1282 Fix typo (#903) a958c264 Rename jvalue to jval in rocksjni 0a165bd7 Have Facebook link point to RocksDB on FB 3639f328 Fix bug in UnScSigned-off-by: xh931076284 <931076284@qq.com> (#1336) 8e061f97 Refactor GetMutableOptionsFromStrings 81747f1b Refactor MutableCFOptions ba65c816 Support POSIX RandomRWFile 1d980a8e Create CNAME 2adab1dd Add API links to the header bar a182b298 Preserve blog comments in markdown f54de923 Adding Dgraph to list of Users (#1291) 9e4aa798 Summary: (#1313) a10e8a05 Fix C api memtable rep bugs. (#1328) eb1d4d53 Release RocksDB 4.12 22d88e24 Allow an offset as well as a length to be specified for byte[] operations in RocksJava JNI (#1264) b06b1913 add C api for set wal_recovery_mode (#1327) 1cca0912 Temporarily revert Prev() prefix support de28a255 Update HISTORY.md for thread-local stats 0fcb6dbe Remove extraneous function prototypes from c.h (#1326) 52ee07b0 Move AddFile() tests to external_sst_file_test.cc 66a91e26 Add NoSpace subcode to IOError (#1320) 67036c04 Fix Flaky ColumnFamilyTest.FlushCloseWALFiles 0e2da497 fix typo in option.h's comment (#1321) 6d61358a Add real Google Analytics ID 2d9d36ea Have "Edit on GitHub" point to master instead of gh-pages 93775189 Update landing page content 1ec75ee7 Add redirects from old blog posts link to new format 607628d3 Support ZSTD with finalized format ce1be2ce Fix build error on Windows (AppVeyor) (#1315) f7669b40 Fix Windows Build 22696b08 Fix uninitlized CompactionJob::SubcompactionState::current_output_file_size c1865e0f Trigger more tests per diff a88677d2 Remove ImmutableCFOptions from public API 80c75593 Fix data race in AddFile() with multiple files + custom comparator bug 5051755e Fix db_bench memory use after free (detected by clang_analyze) 4fd08f4b Ensure Correct Behavior of StatsLevel kExceptDetailedTimers and kExceptTimeForMutex (#1308) e14fbaae Add FAQ based on the front page of the current rocksdb.org 3c226240 Migrate the RocksDB Worpdress blog over to Jekyll ee0e2201 Transfer the current Getting Started contents to GitHub Pages 5a0e9a4c Initial Landing Page 9447a854 Remove the `doc` directory 32149059 Merge options source_compaction_factor, max_grandparent_overlap_bytes and expanded_compaction_factor into max_compaction_bytes 4590b53a add stats to Cache::LookUp() 85bb3082 Expose Utility function StringToMap() (#1306) 8ce1b844 Fix Travis on Mac 380e651a Fix Mac build failure (#1309) 1613fa94 Thread-specific histogram statistics 6a14d55b add prefix_seek_mode to db_iter_test de47e2bd Fix ClockCache memory leak f099af4c Fix travis db74b1a2 fix bug in merge_iterator when data race happens b18f9c9e add nullptr check to internal_prefix_transform 4e395e87 Update docs README.md 2482d5fb support Prev() in prefix seek mode 7541c7a7 Fix cache_test valgrind_check failure c8513cde Update the download location of Snappy (#1304) b49b92cf Introduce Read amplification bitmap (read amp statistics) c7004840 store prefix_extractor_name in table 4ad928e1 add comment to SimCache to estimate actual capacity e9b2af87 Expose ThreadPool under include/rocksdb/threadpool.h 23a05700 Document memtable flush behavior in CancelAllBackgroundWork() dade61ac Mitigate regression bug of options.max_successive_merges hit during DB Recovery cce702a6 [db_bench] Support single benchmark arguments (Repeat for X times, Warm up for X times), Support CombinedStats (AVG / MEDIAN) 3586901f cat tests logs sorted by exit code b2ce5953 Persist data during user initiated shutdown 4b3438d2 Fix parallel valgrind (valgrind_check) a081f798 Relax consistency for thread-local ticker stats b10d65c2 Update and slightly clarify instructions in build_detect_platform (#1301) f85f99bf Fix the Windows build of RocksDB Java. Similar to https://github.com/facebook/rocksdb/issues/1220 (#1284) 7b810951 Fix a crash when compaction fails to open a file 7c958683 Thread-specific ticker statistics ea9e0757 Add initial GitHub pages infra for RocksDB documentation move and update. (#1294) 2a9c9710 [Flaky Test] Disable DBPropertiesTest.GetProperty d76ddf32 Disable ClockCache db_crashtest cec2c643 fix data race in NewIndexIterator() in block_based_table_reader.cc badbff65 Not insert into block cache if cache is full and not holding handle 4a16c32e Option to cache index/filter blocks with priority 99c4af71 Make ClockCache available with TSAN build f57bc1d0 Fix lambda expression for clang/windows 5440675c Fix lambda capture expression for windows 6584cec8 Fold function for thread-local data 817eeb29 Add singleDelete to RocksJava (#1275) ffdf6eee Add Status to RocksDBException so that meaningful function result Status from the C++ API isn't lost (#1273) ecf90038 Fix bug in printing values for block-based table 72f8cc70 LRU cache mid-point insertion 6a17b07c Add TablePropertiesCollector support in SstFileWriter 78837f5d TableBuilder / TableReader support for range deletion 4cc37f59 Introduce ClockCache ff17a2ab Adding TBB as dependency. 49d88be0 c abi: allow compaction filter ignore snapshot (#1268) 0b63f51f fixes 1215: execute_process(COMMAND mkdir ${DIR}) fails to create a directory with cmake on Windows (#1219) 3981345b Small nits (#1280) 2a2ebb6f Move LRUCache structs to lru_cache.h header 2fc2fd92 Single Delete Mismatch and Fallthrough statistics 3771e379 WriteBatch support for range deletion 236756f2 Make SyncPoint return immediately when disabled 64a0082c Fix DBSSTest::AddExternalSstFileSkipSnapshot valgrind fail dd7a748c Fix java build 4fe12baa Make db_bench less space for --stats_per_interval 6525ce4c Compaction stats printing: "batch" => "commit group" a117891b Fixed typo (#1279) b248e98c Fix a destruction order issue in ThreadStatusUpdater deda159b Added min/max/avg data block size output to sst_dump e408e98c add Name() to Cache a297643f Fix valgrind memory leak d11c09d9 Eliminate memcpy from ForwardIterator d3675550 Added further Java API options for controlling concurrent writes ebdfe34c Exposed further Java API options for controlling compaction d1be5946 Improve documentation of SliceTransform. 6056d631 Improve comment and bug fix for GetOptionsFromMap functions in convenience.h 76a67cf7 support stackableDB as the baseDB of transactionDB 67c1ae88 Travis build break fix b693ba68 Minor PinnedIteratorsManager Refactoring db3dfb16 Fixes for arcanist config (#1271) 87c91bd8 Persistent Read Cache (8) Benchmark tooling 2914de64 add sim_cache stats to Statistics 8b79422b [Proof-Of-Concept] RocksDB Blob Storage with a blob log file. 4beffe00 Fix test data race in two FaultInjectionTest tests 821bcb0b util/arena.cc: FreeBSD: More portable use of mmap(MAP_ANON) (#1254) 5370f44a Increase RocksDB version 56dd0341 read_options.background_purge_on_iterator_cleanup to cover forward iterator and log file closing too. ccecf3f4 UniversalCompaction should ignore sorted runs being compacted (when compacting for file num) 1b0069ce Remove non-gtest from parallelized tests 638c49f2 Change HISTORY.md for release 4.11 6b8e9c68 fix vs generator (#1269) c38b075e Update HISTORY.md 8f399e3f Update HISTORY.md 98d0b78e Added check_snapshot option in the DB's AddFile function (#1261) 9fd68b7f set travis open file descriptor limit 59ddb505 Fix travis build break f4d98636 Added SetOptions support to RocksJava (#1243) 7882cb97 Make DBOptionsTest::EnableAutoCompactionAndTriggerStall less falky 44f5cc57 Add time series database (resubmitted) 7c4615cf A utility function to help users migrate DB after options change 5bb0a7f7 Update appveyor.yml 86396cc1 Update appveyor.yml c1db098d Update appveyor.yml 7da2eaf0 Update appveyor.yml 34723b4c Cleanup unused variable pending_fsync_. 7cc0dbd6 cat all logs in sandcastle output 9253767a Correct geHistogramData() -> getHistogramData() (#1257) f35b16f2 db_bench add an option of --base_background_compactions c3a4bea5 Fix flaky test `ObsoleteFiles` 8234faab Fix failed test 4990c0d1 Remove deprecated LEVELDB_PLATFORM_POSIX 7323e4c8 Fix clang on macOS ee027fc1 Ignore write stall triggers when auto-compaction is disabled e4609a74 Fix Windows build issues (#1253) 2306167d Fix clang build failure and refactor unit test 343304e1 Use StopWatch to do statistic job in db_impl_add_file.cc cdc4eb68 Add a GetComparator() function to the ColumnFamilyHandle base class so that the user's comparator can be retrieved. 712dd27e Build break fixes 0155c73d Fix parallel tests `make check -j` c49ea68c Fix to enable running CI jobs locally 726c2f7e Build break fix d51dc96a Experiments on column-aware encodings c116b478 Persistent Read Cache (part 6) Block Cache Tier Implementation 64046e58 Write a benchmark to emulate time series …

andresilva · 2017-12-13T16:03:31Z

Should we release a new version? I will do another PR exposing a compaction option, so maybe we can release after that?

* Squashed 'rocksdb-sys/rocksdb/' changes from 98084910..6f35cb93 6f35cb93 bump version c1565071 update history dd0efa4e Preserve overlapping file endpoint invariant aead4041 fix HISTORY.md typo a0cdc3ce Bump version to 5.8.7 7513f635 Fix IOError on WAL write doesn't propagate to write group follower 9e47084c Bump version to 5.8.6 36074ba5 Enable cacheline_aligned_alloc() to allocate from jemalloc if enabled. aa00523e Add -DPORTABLE=1 to MSVC CI build cf2b9823 Bump version to 5.8.5 e8c9350f Blob DB: not using PinnableSlice move assignment 4907d246 Bump version to 5.8.4 5d928c79 Blob DB: Fix race condition between flush and write 725bb9d6 Blob DB: Fix release build b7367fe8 Bump version to 5.8.3 13b2a9b6 Blob DB: use compression in file header instead of global options 5dc70a15 Fix PinnableSlice move assignment 9019e912 dynamically change current memtable size 7f1815c3 Bump version to 5.8.2 2584a18e Blob DB: Fix BlobDBTest::SnapshotAndGarbageCollection asan failure 17f67b54 PinnableSlice move assignment 6fb56c58 Blob DB: Add compaction filter to remove expired blob index entries f90ced92 Blob DB: fix snapshot handling 632f36dc Blob DB: option to enable garbage collection 11bacd57 Blob DB: Fix flaky BlobDBTest::GCExpiredKeyWhileOverwriting test f98efcb1 Blob DB: Evict oldest blob file when close to blob db size limit c1e99edd Blob DB: cleanup unused options ffc3c62c Blob DB: Initialize all fields in Blob Header, Footer and Record structs 9e825409 Blob DB: update blob file format d66bb21e Blob DB: Inline small values in base DB 05d5c575 Return write error on reaching blob dir size limit 2b8893b9 Blob DB: Store blob index as kTypeBlobIndex in base db 419b93c5 Blob DB: not writing sequence number as blob record footer 8afb0036 fix lite build dded348d Blob DB: Move BlobFile definition to a separate file 37473612 add GetLiveFiles and GetLiveFilesMetaData for BlobDB 8cff6e94 Enable WAL for blob index c2934729 Add ValueType::kTypeBlobIndex eae53de3 Make it explicit blob db doesn't support CF 65aec19d Fix memory leak on blob db open 30b38c98 TableProperty::oldest_key_time defaults to 0 2879f4be Bump version to 5.8.1 88595c88 Add DB::Properties::kEstimateOldestKeyTime 266ac245 Bumping version to 5.8 64185c23 update HISTORY.md for DeleteRange bug fix e83d6a02 Not using aligned_alloc with gcc4 + asan 0980dc6c Fix wrong smallest key of delete range tombstones b7679723 avoid use-after-move error c4174427 CMake: Fix formatting c21ea8f7 CMake: Add support for CMake packages 54443455 add Erlang to the list of language bindings 2972a702 Minor updates to FlushWAL blog fbfa3e7a WriteAtPrepare: Efficient read from snapshot list b01f426f Blog post for FlushWAL 503db684 make blob file close synchronous 3c840d1a Allow DB reopen with reduced options.num_levels 92bfd6c5 Fix DropColumnFamily data race 7fdf735d Pinnableslice examples and blog post 7fbb9ecc support disabling checksum in block-based table 19cc66dc fix clang bug in block-based table reader 7eba54eb test compaction input-level split range tombstone assumption cd26af34 Add unit test for WritePrepared skeleton a1247981 Improved transactions support in C API c10b3913 LANGUAGE-BINDINGS.md: add another rust binding 90177432 Remove leftover references to phutil_module_cache 234f33a3 allow nullptr Slice only as sentinel ccf7f833 Use PinnableSlice in Transactions 1dfcdb15 Extend pin_l0 to filter partitions 39ef9005 stop calling memcmp with nullptrs 78cb6b61 Provide byte[] version of SstFileWriter.merge to reduce GC Stall 867fe92e Scale histogram bucket size by constant factor f004307e CMake improvements 09ac6206 Circumvent ASAN false positive 5b68b114 Blob db create a snapshot before every read 4624ae52 GC the oldest file when out of space 8ace1f79 add counter for deletion dropping optimization 0d8e992b Revert the mistake in version update 5358a805 add VerifyChecksum to HISTORY.md ed0a4c93 perf_context measure user bytes read 1efc600d Preload l0 index partitions bddd5d36 Added mechanism to track deadlock chain c1384a70 fix db_stress uint64_t to int32 cast 29877ec7 Fix blob db crash during calculating write amp 8f2598ac Enable Cassandra merge operator to be called with a single merge operand 9a44b4c3 Allow merge operator to be called even with a single operand ac8fb77a fix some misspellings 23593171 minor improvements to db_stress af012c0f fix deleterange with memtable prefix bloom 1c8dbe2a update scores after picking universal compaction eb642530 Update WritePrepared with the pseudo code 132306fb Remove PartialMerge implementation from Cassandra merge operator 71598cdc Fix false removal of tombstone issue in FIFO and kCompactionStyleNone 3204a4f6 Fix missing stdlib include required for abort() 7aa96db7 db_stress rolling active window dfa6c23c Update RocksDBCommonHelper to use escapeshellarg e367774d Overload new[] to properly align LRUCacheShard ad42d2fc Remove residual arcanist_util directory 279296f4 properly set C[XX]FLAGS during CMake configure-time checks c5f0c6cc compile with correct flags to determine SSE4.2 support 185ade4c cmake: support more compression type 5449c099 rocksdb: make buildable on aarch64 a144a978 Fix for CMakeLists.txt on Windows for RocksJava acf935e4 fix deletion dropping in intra-L0 8254e9b5 make sst_dump compression size command consistent 74f18c13 db_bench support for non-uniform column family ops 5de98f2d approximate histogram stats to save cpu 3f588843 Fix c_test ASAN failure e5a1b727 Fix blob DB transaction usage while GC 6f051e0c fix corruption_test valgrind ac098a46 expose set_skip_stats_update_on_db_open to C bindings 666a005f Support prefetch last 512KB with direct I/O in block based file reader ad77ee0e Revert "Makefile: correct faligned-new test" b87ee6f7 Use more keys per lock in daily TSAN crash test 25df2425 Add column families related functions (C API) 64f84843 block_cache_tier: fix gcc-7 warnings 0cecf815 Write batch for `TransactionDB` in C API 6a9de434 Windows.h macro call fix 23c7d135 fix comment 1fbad84b Makefile: correct faligned-new test 7848f0b2 add VerifyChecksum() to db.h 47ed3bfc fix WinEnv assertions d97a72d6 Try to repair db with wal_dir option, avoid leak some WAL files 36375de7 gcc-7/i386: markup intentional fallthroughs bdc056f8 Refactor PessimisticTransaction a9a4e89c Fix valgrind complaint about initialization 4ca11b4b Update USERS.md c9804e00 Refactor TransactionDBImpl 20dc5e74 Optimize range-delete aggregator call in merge helper. 0d4a2b73 Avoid blob db call Sync() while writing 627c9f1a Don't add -ljemalloc when DISABLE_JEMALLOC is set dce6d5a8 db_bench background work thread pool size arguments 4f81ab38 Makefile: fix for GCC 7+ and clang 4+ 92afe830 Update all blob db TTL and timestamps to uint64_t 5883a1ae Fix /bin/bash shebangs cc01985d Introduce bottom-pri thread pool for large universal compactions 0b814ba9 Allow concurrent writes to blob db 2c45ada4 Blob DB garbage collection should keep keys with newer version 58410aee Fix the overflow bug in AwaitState c3d5c4d3 Refactor TransactionImpl 060ccd4f support multiple CFs with OPTIONS file 34538706 Fix statistics in RocksJava sample 1900771b Dump Blob DB options to info log 3218edc5 Fix universal compaction bug 6a36b3a7 fix db get/write stats a84cee81 Add a missing "once" in .h 21696ba5 Replace dynamic_cast<> e85f2c64 Prevent empty memtables from using a lot of memory ac748c57 Fix FIFO Compaction with TTL tests aaf42fe7 Move blob_db/ttl_extractor.h into blob_db/blob_db.h aace4651 Fix license headers in Cassandra related files 50a96913 CacheActivityLogger, component to log cache activity into a file 6083bc79 Blob DB TTL extractor 710411ae fix asan/valgrind for TableCache cleanup 3a3fb00b TARGETS file not setting sse explicitly fca4d6da Build fewer tests in Travis platform_dependent tests 8f553d3c remove unnecessary internal_comparator param in newIterator 7f6d012d "ccache -C" in Travis d12691b8 move TableCache::EraseHandle outside of db mutex f33f1136 fix db_bench argument type e7697b8c Fix LITE unit tests 3ce20e98 Fix use of RocksDBCommonHelper in cont_integration.sh c281b448 Revert "CRC32 Power Optimization Changes" 9980de26 Fix FIFO compaction picker test 2289d381 CRC32 Power Optimization Changes 30b58cf7 Remove the orphan assert on !need_log_sync fe1a5559 Fix flaky write_callback_test addbd279 5.6.1 release blog post 30edff30 buckification: remove explicit `-msse*` compiler flags 2b259c9d Lower num of iterations in DeadlockCycle test 277f6f23 Release note for partitioned index/filters 5e731a13 Remove unused rocksdb arcanist lib 9b11d434 Fix broken links 06f19174 add vcpkg as an windows option ea8ad4f6 Fix compaction div by zero logging 34112aef Added db paths to c 1d8aa296 Gcc 7 ParsedInternalKey replace memset with clear function. a4c42e80 Fix UBSAN issue of passing nullptr to memcmp 16e03882 LRUCacheShard cache line size alignment 216644c6 enable UBSAN macro in TARGETS e67b35c0 Add Iterator::Refresh() a34b2e38 Fix caching of compaction picker's next index 72502cf2 Revert "comment out unused parameters" 1d7048c5 comment out unused parameters 534c255c Cassandra compaction filter for purge expired columns and rows 63163a8c Remove make_new_version.sh 0302da47 Reduce blob db noisy logging 3e5ea29a Fix Flaky DeleteSchedulerTest::ImmediateDeleteOn25PercDBSize a22b9cc6 overlapping endpoint fixes in level compaction picker ffd2a2ee delete ExpandInputsToCleanCut failure log 3e6e863b Remove arcanist_util directory 36651d14 Moving static AdaptationContext to outside function 6e3ee015 Update java/rocksjni.pom ecff9d5e Include write_buffer_manager in ImmutableDBOptions::Dump ae28634e Remove some left-over BSD headers 33b1de82 Remove format compatibility hack 2f375154 checkout local branch in check_format_compatible.sh ddb22ac5 avoid collision with master branch in check format 0c03a7f1 set the remote for git checkout 7ac184c6 Revert cmake -DNDEBUG for non-MSVC 0655b585 enable PinnableSlice for RowCache 00464a31 Fix column_family_test with LITE build b2dd192f tools/write_stress.cc: Correct "1204" typos. cbaab304 table/block.h: change memset f1a056e0 CodeMod: Prefer ADD_FAILURE() over EXPECT_TRUE(false), et cetera 4a2e4891 Add back the LevelDB license file a7321fc9 Remove the licensing description in CONTRIBUTING.md 3c327ac2 Change RocksDB License 13201336 Make TARGETS file portable ccf5f08f Set CACHE_LINE_SIZE for s390, PPC, ARM64 67510eef db_crashtest.py: remove need for shell 4267eb00 Remove punit tests 5bfb67d9 Enable write rate limit for updaterandom benchmark 20a691d9 Update HISTORY to release 5.7 98d1a551 db_bench to by default verify checksum 26ce69b1 Update blob db to use ROCKS_LOG_* macro 43e4eef7 remove unnecessary fadvise 21b17d76 Fix BlobDB::Get which only get out the value offset 70440f7a Add virtual func IsDeleteRangeSupported 7550255c Add JAVAC_ARGS as Makefile variable 7a0b5de7 Gcc 7 ignored quantifiers 000bf0af Improve the design and native object management of Stats in RocksJava 269d383d Bump version to 5.7 c32f2722 Fixes db_bench with blob db fcd99d27 db_bench_tool: fix buffer size 87128bd5 fix regression test 8f927e5f Fix undefined behavior in Hash 643b787c Added a note about LZ4 compression dependency 56656e12 Temporarily disable FIFOCompactionWithTTLTest b5fb85ec fix valgrind init complaint 657df29e Add max_background_jobs to db_bench a43c053a remove duplicated utilities/merge_operators/cassandra/test_utils.cc in src.mk 7c4a9e6c Initialize a variable in ldb to make code analysis tool happy 98669b53 init filters_in_partition_ 0013bf14 fix asan and valgrind leak report in test 521b4c28 rocksdb 5.5.1 release post 33042573 Fix GetCurrentTime() initialization for valgrind f6b9d935 Fix clang error in PartitionedFilterBlockBuilder 45b9bb03 Cut filter partition based on metadata_block_size f4ae1bab update history for OnBackgroundError and DeleteRange fix 1cb8c6de Add -enable_pipelined_write to db_bench and add two defaults 7604b463 Update the AddDBStats in LITE 1e34d07e Simplify and document sync rules for logs_ etc d310e0f3 Regression test for empty dedicated range deletion file e9f91a51 Add a fetch_add variation to AddDBStats c1b375e9 skip generating empty sst 67b417d6 fix format compatible test afbef651 Bug fix: Fast CRC Support printing is not honest 397ab111 Improve Status message for block checksum mismatches 18c63af6 Make "make analyze" happy 01534db2 Fix the reported asan issues 1cd45cd1 FIFO Compaction with TTL 982cec22 Fix TARGETS file tests list b49b3710 allow numa >= 2.0.8 e517bfa2 CLANG Tidy dc3d2e4d update compatible test 89468c01 Fix Windows build broken by 5c97a7c0664d4071768113814e9ba71fe87e18cf 51778612 Encryption at rest support 7061912c Trivial typo in HISTORY.md 2a9cd879 Fix jni WriteBatchThreadedTest 0025a364 revert perf_context and io_stats to __thread 5c97a7c0 Unit Tests for sync, range sync and file close failures 4cee11f4 Intra-L0 blog post 857e9960 Improve the error message for I/O related errors. d757355c Fix bug that flush doesn't respond to fsync result 8e6345d2 Update rename of ParanoidCheck 499ebb3a Optimize for serial commits in 2PC 0ac4afb9 Sanitize partitioning options 521724ba fixed wrong type for "allow_compaction" parameter 71f5bcb7 Introduce OnBackgroundError callback 88cd2d96 Downgrade option sanitiy check level for prefix_extractor 6837a176 Fix Data Race Between CreateColumnFamily() and GetAggregatedIntProperty() af174675 WriteBufferManager will not trigger flush if much data is already being flushed 9467eb61 Fix flush assertion with tsan 048446fc Fix cassandra ASAN use-after-free a21db161 Implement ReopenWritibaleFile on Windows and other fixes c430d69e fix coredump for release nullptr 0d278456 default implementation for InRange cbd825de Create a MergeOperator for Cassandra Row Value 2c98b06b Remove pin_slice option by making it the default c80c6115 add db_bench options for partitioning 6a3377f4 Synchronize statistic enumeration values between statistics.h and java API 53dda879 Do not run RateLimiterTest.Rate test on Travis+Mac OSX. ae8571f5 Fix blob db compression bug 7a380def Update blob_db_test 89ad9f3a Allow ignoring unknown options when loading options from a file 6b5a5dc5 fixed typo 0f228be3 fixed typo in util/dynamic_bloom.h c217e0b9 Call RateLimiter for compaction reads 91e2aa3c write exact sequence number for each put in write batch 6f4154d6 record index partition properties 5d5a28a9 Fix Clang release build broken by 5582123dee8426a5191dfd5e846cea8c676c793c 0175d58c Make direct I/O write use incremental buffer 7a270069 GNU C library for struct tm has 2 additional fields. d713471d Limit trash directory to be 25% of total DB 9bb91e93 Dedup release 27b45016 Update HistogramTypes in the Java API e97304c6 update history for 5.6 5582123d Sample number of reads per SST file db818d2d Fix RocksDB Lite build with CLANG a472c4ae update 5.5 change log bc09c8a0 Fix crash in PosixWritableFile::Close() when fstat() fails 6d0f22e4 Fix mock_env.cc uninitialized variable c2012d48 Java APIs for put, merge and delete in file ingestion 85dace2a Disable DBRangeDelTest::TailingIteratorRangeTombstoneUnsupported for ubsan d4f7731b fix travis error with init time in mockenv 550a1df7 Fix clang errors by asserting the precondition cc5f9339 Fix concurrency issue with filter_block_set_ 2e64f450 bump version to 5.6 afbc2d0d Force travis to build with clang on MacOS b172a3f1 Fix warnings while generating RocksJava documentation 52a7f38b WriteOptions.low_pri which can throttle low pri writes if needed 26a8a807 Switch from CentOS 5 to CentOS 6 for crossbuilding RocksJava dba9f372 Fix db_write_test clang/windows build failure c7662a44 fixed typo 7e8d95cc Fix the Java build which was broken by a4d9c02 7e5fac2c remove test dir before exit when current regression is running 7f6c02dd using ThreadLocalPtr to hide ROCKSDB_SUPPORT_THREAD_LOCAL from public… 138b87ea Fix interaction between CompactionFilter::Decision::kRemoveAndSkipUnt… 95b0e89b Improve write buffer manager (and allow the size to be tracked in block cache) a4d9c025 Pass CF ID to MemTableRepFactory f68d88be Fix DBWriteTest::ReturnSequenceNumberMultiThreaded data race 215076ef Fix TSAN: avoid arena mode with range deletions 3a8a848a account for L0 size in estimated compaction bytes 0fae3f5d codemod: format TARGETS with buildifier [5/5] (D5092623) 87219960 add checkpoint support for single db in regression test 5a9b4d74 Retire memenv https://github.com/facebook/rocksdb/pull/2082 d6019651 sync internal/external TARGETS bbaba51b Add missing index type to C-API 292edfd5 travis: test with xcode8.3 (OS X 10.12) 0dc3040d db: avoid `#include`ing malloc and jemalloc simultaneously 9b3ed835 fix regression test 9c9909bf Support ingest file when range deletions exist ad19eb86 Fixing blob db sequence number handling 51ac91f5 Histogram of number of merge operands 345878a7 update blob_db_test cbc821c2 change regression rebuild to one level 103d0692 Avoid unsupported attributes when not building with UBSAN 5fd04566 travis: reduce the number of travis builders 2d05002b RocksDB 5.4.5 release blog post 7eca90f1 Update RocksDB blog authors d03c3449 update comment of GetNextFile f7bb1a00 support merge and delete in file ingestion c2c62ad4 Reorder variables of ReadOptions 7bb1f5d4 Increase of compaction threads should be logged at info level instead of a warning 6c456eca Clean zstd files 347e16f8 codemod: replace `headers = AutoHeaders.*` with `auto_headers` 0be636bf Fix db_bench build break with blob db 135ee6a3 fix tsan crash data race a99fb992 fix column_family_test asan f41bffb3 travis: clang-3.6 -> clang-4.0 e7612798 update buckifer/TARGETS bb01c188 Introduce max_background_jobs mutable option 5a253046 Fix the CMakeLists for RocksJava 41cbb727 options.delayed_write_rate use the rate of rate_limiter by default. 50680346 range sync should be enabled 02594b5f Fix build errors in blob_dump_tool with GCC 4.8 52d9e5f7 Fix column family seconds_up accounting 7d8207f1 Fix errors in clang-analyzer builds 85b8569a Fix release build on Linux 69ec8356 Allow SstFileWriter to use the rate limiter 6cc9aef1 New API for background work in single thread pool 9d0a07ed Fix rocksdb.estimate-num-keys DB property underflow 578fb0b1 Simple blob file dumper ac39d6be Core-local statistics 3e86c0f0 disable direct reads for log and manifest and add direct io to tests 15ba4d6c Address MS Visual Studio 2017 issue with autovector 88c818e4 Replace deprecated RocksDB#addFile with RocksDB#ingestExternalFile 228f49d2 Fix data races caught by tsan 4c9d2b10 remove #include port/port.h in public header file 07bdcb91 New WriteImpl to pipeline WAL/memtable write d746aead Suppress clang-analyzer false positive 217b866f column_family_test: EnvCounter::num_new_writable_file_ to be atomic 9f839a7f keep util/build_version.cc when make clean 7eecd40a add emacs tags file - etags 9bbba4fe Remoe unused BlockBasedTable::compaction_optimized_ f5ba131b Fixed some spelling mistakes 146b7718 Fix mingw compilation with -DNDEBUG a36220cc fix unity test 0ebdd705 fixed typo 8032f4cb Remove -pie in TSAN 362ba9b0 Release RocksDB 5.5.0 ba685a47 Support ingest_behind for IngestExternalFile 01ab7b52 Add ROCKSDB_LIBRARY_API macro to a few C APIs, to fix windows build cb9392a0 add Transactions and Checkpoint to C API 445f1235 s/std::snprintf/snprintf cd593c28 Fix travis java_test f720796e fixed typo a48a62d5 define NDEBUG in CMake non-debug builds 1ca723db C API: support pinnable get 2ef15b85 Core-local stats blog post 4f9e69cc fix log err 11c5d474 cross-platform compatibility improvements d0043330 Put lib files into suitable path in RPM package 86d54925 Fix build error with blob DB. 254c4680 Fix the RocksJava Release on Windows 7a47b431 Fix .gitignore pattern fa5a15ce Make sure that zstd is statically linked correctly in the Java static build 3fa9a39c Add GetAllKeyVersions API 1a60982a Simplified instructions for CentOS a5cc7ece Facility for cross-building RocksJava using Docker ccd3dddf Blog post for partitioned index/filters b145c34d Update blog authors bbe9ee7d core-local array type conversions c2be4343 Build and link with ZStd when creating the static RocksJava build c61e72c4 Add missing files of blob_db to CMake file 3907c94f Fix ColumnFamilyTest:BulkAddDrop cda5fde2 CoreLocalArray class 93949667 update TARGETS 4e83b800 title: Bulkoading -> title: Bulkloading d85ff495 Blob storage pr 492fc49a fix readampbitmap tests be421b0b portable sched_getcpu calls 0f559abd Add NO_UPDATE_BUILD_VERSION option to makefile 3a04a254 Flink state 35df23fe Fix suite exclisions e7cea86f Fixes the CentOS 5 cross-building of RocksJava 259a00ea unbiase readamp bitmap a6209669 port: updated PhysicalCoreID() df035b68 Print compaction_options_universal.stop_style in LOG file 4897eb25 dont skip IO for filter blocks 3f73d54b Add C API to set max_file_opening_threads option 0b69e507 Define CACHE_LINE_SIZE only when it's not defined 2cd00773 Add bulk create/drop column family API 40af2381 Object lifetime in cache fdaefa03 travis: add Windows cross-compilation a30a6960 do not read next datablock if upperbound is reached 2d42cf5e Roundup read bytes in ReadaheadRandomAccessFile 264d3f54 Allow IntraL0 compaction in FIFO Compaction 8c3a180e Set lower-bound on dynamic level sizes 7c1c8ce5 Avoid calling fallocate with UINT64_MAX a45e98a5 max_open_files dynamic set, follow up 6b99dbe0 fix memory alignment with logical sector size e7ae4a3a Max open files mutable 60847a3b port: updated PhysicalCoreID() b551104e support PopSavePoint for WriteBatch 498693cf Remove orphaned Java classes 5e2ebf2b travis: add CMake compilation af6fe69e Fix an issue of manual / auto compaction data race 6798d1f3 Revert "Delete filter before closing the table" 89833577 Delete filter before closing the table 47a09b0a Avoid pinning when row cache is accessed aeaba07b Remove an assert that causes TSAN failure. 0b90aa95 Set VALGRIND_VER a2b05210 Make PosixLogger::flush_pending_ atomic da4b2070 Fix WriteBatchWithIndex address use after scope error d616ebea Add GPLv2 as an alternative license. 4439b459 Add documentation license 0ca3ead0 add GetRootDB() in DeleteFilesInRange cdad04b0 Remove double buffering on RandomRead on Windows. e15382c0 Disable two flaky tests 2150cc1f fix WritableFile buffer size in direct IO efc361ef Add user stats Reset API 6616e4d6 add prefetch to PosixRandomAccessFile in buffered io f6a27d0b Extract statistics tests into separate file 7eddecce support bulk loading with universal compaction 3b4d1b7a add <sys/sysmacros.h> to avoid warning with glibc 2.25 e5e545a0 Reunite checkpoint and backup core logic 72c21fb3 call GetRootDB() before cast to DBImpl* in CancelAllBackgroundWork 4c9447d8 Add erase option to release cache 04d58970 AIX and Solaris Sparc Support afff9951 Respect deprecated flag in table options 066cfbac Adding -noprofile to CMakeLists for Windows cb885bcc set compaction_iterator earliest_snapshot to max if no snapshot 7534ba7b StackableDB should pass ResetStats() c1fbf91b Fixing Solaris Sparc crash due to cached TLS 963eeba4 Revert how check_format_compatible.sh checkout release branches. 97005dbd tools/check_format_compatible.sh to cover option file loading too 8f619678 Add cpu usage to regression benchmarks (4th attempt) df74b775 Limit backups opened 1dd77605 Change L0 compaction score using level size 927bbab2 Revert "Add cpu usage to regression benchmarks (3rd attempt)" 8e84a388 Re-add index_per_partition but as deprecated 1553659d Add more recent versions to tools/check_format_compatible.sh 966ebb02 Hide event listeners from lite build 476e80be Add cpu usage to regression benchmarks (3rd attempt) c49d7046 Add DB:ResetStats() 0fcdccc3 Blob storage helper methods a6439d79 CMake: compile with -O2 e67f0adf enable O2 optimization for lz4 bc397325 CMake: add support for SSE4.2 7d5f5aa9 Separate compile and link for shared library 07165273 remove warning 6e8d6f42 readahead backwards from sst end ca96654d Change Build Env to gcc-5 e9e6e532 Simplify write thread logic 6799c7e0 Pass in remote as a param to branch creation script 44fa8ece change use_direct_writes to use_direct_io_for_flush_and_compaction 13b50358 add space for buggy kernel warning b6b9359e Fix BYTES_WRITTEN accounting 13369fbd Update ShipIt to honor TARGETS updates f2449ce9 Remove .deprecated_arcconfig 415be221 RocksDB Release 5.4 : Update HISTORY.md and build version. 3eab41d7 java dependencies test -s -> use test -d a22ed4ea internal_repo_rocksdb to build Java and RocksDB LITE 9f2cc59e sync TARGETS file 10d75469 set readahead buffer size from roundup(user_size) + 4k to roundup(use… ba7da434 fix db_stress crash caused by buggy kernel warning 6257837d Add ROCKSDB_JAVA_NO_COMPRESSION flag 6a6723ee Move MergeOperatorPinning tests to be with other merge operator tests 6a8d5c01 Revert "Report cpu usage using time command" 8f47a975 File level histogram should be printed per CF, not per DB 9300ef54 Fix shared lock upgrades 1f8b119e Limit maximum memory used in the WriteBatch representation 97ec8a13 Report cpu usage using time command 20778f2f Adding comments to the write path 7124268a Reduce the number of params needed to construct DBIter 04abb2b2 FreeBSD only requires WITH_JEMALLOC, not the rest 61730186 dummy diff 360e9960 Summary: Remove .arcconfig 69a5e646 Deprecate .arcconfig 9690653d Add a verify phase to benchmarks dd8f9e38 Fix compilation for GCC-5 c2954f9b Add Travis job to build examples 72fc1e9d avoid non-existent O_DIRECT on OpenBSD ff972870 Refactor compaction picker code 9e729390 only FALLOC_FL_PUNCH_HOLE when ftruncate is buggy 343b59d6 Move various string utility functions into string_util 1d068f60 Fix CompactRange incorrect buffer release df6f5a37 Move memtable related files into memtable directory 107c5f6a CMake: more MinGW fixes d2dce561 Move some files under util/ to separate dirs c50e3750 Use a human readable size for level report ce64b8b7 Divide db/db_impl.cc 02799ad7 Revert "delete fallocate with punch_hole" e2a7b202 Release note for partition filters af256eb2 build db every monday e5a1372b Rework test running script. d659faad Level-based L0->L0 compaction a12306fa Add a notice on gflags installation in INSTALL.md 43010a92 Revert "[rocksdb][PR] CMake: more MinGW fixes" a30b75cd Add buckifier script to github repo 3450ac8c CMake: more MinGW fixes 90cfd464 update IterKey that can get user key and internal key explicitly e2c6c063 add TimedEnv 9e445318 Refactor WriteImpl (pipeline write part 1) 6ef8c620 Move auto_roll_logger and filename out of db/ a1c469d7 Add release notes for PinnableSlice 0537f515 fix run_remote with strong quoting 72e60009 fixed misses on Centos library installation instructions 88cc81df auto_roll_logger_test to move away from real sleep d25e28d5 replace sometimes-undefined uint type with unsigned int a1d7e487 Add L0 write-amp to compaction level stats b6d60906 CMake: support AVX2 in MinGW bd7d1383 test remote instead run remote in regression test c81a805f test db existence on the remote host 5fc1e676 add -rf when remove db in regression test 4ab4049f gflags has moved to GitHub 4e006501 make all DB::Get overloads virtual 6401a8b7 Fix build with MinGW 80fe5b38 disable test: DeleteSchedulerTest.DynamicRateLimiting1 a9c86f51 backup garbage collect shared_checksum tmp files da175f7e exit with code 2 when there is already a db_bench running in regression test 0ee7f040 Added missing options to RocksJava c6d04f2e Option to fail a request as incomplete when skipping too many internal keys 58179ec4 Cleanup of ThreadStatusUtil structures should use the DB's reference f3607640 add ldb build to regression test 8a8c9674 Enable Fast CRC32 for Win64 f9813b85 Added SstFileWriter construtor without explicit comparator to JNI api 8d3cb4f2 Added naming of backup engine threads 67d76237 Expose the stalling information through DB::GetProperty() 0fd57492 delete fallocate with punch_hole 41fe9ad7 Hide usage of compaction_options_fifo from lite build e7731d11 Configure index partition size 69c8d524 Fix jni library name for PowerPC Architecture 34a70859 Fix segmentation fault caused by #1961 8dee8cad Enable fifo compaction benchmark to db_bench a5c8b543 fix a header include 91b5feb3 Fix Windows Build broken by a recent commit 41ccae6d Add C API functions (and tests) for WriteBatchWithIndex 88bb6f6b non_shm CI should run tests on /tmp 8888de2b Update .gitignore file in examples 203136e7 Fix Compilation errors when using IBM Java f4fce475 Fix clang compile error - [-Werror,-Wunused-lambda-capture] a084b26a Blog post for releasing 5.2.1 15950fe3 Remove ASSERT_EQ(boolean, ...) 3e56c7e0 make total_log_size_ atomic 909028e2 HISTORY.md for log_size_for_flush in CreateCheckpoint() be723a8d Optionally construct Post Processing Info map in MemTableInserter e474df94 db_bench: not need to check mmap for PlainTable 8b0097b4 Readers for partition filter 9ef3627f Allow checkpointing without flushing 17866ecc Allow Users to change customized ldb tools' header in help printing a2a88331 remove deleted option from benchmark.sh 78cb1955 add checkpoint to ldb 4b04addf updated solution if "make format" command fails 8f5bf044 Flush triggered by DB write buffer size picks the oldest unflushed CF 6908e24b dynamic setting of stats_dump_period_sec through SetDBOption() 93c68b64 change regression bash file with debug mode 21d8c317 remove LIKELY from public headers 36ad7577 INSTALL: document USE_SSE 9272e12f avoid ftruncate twice in buffered io d52f334c Break stalls when no bg work is happening e66221ad fix db_bench rate limiter callsites dbae438a Replace "DEPRECATED" comment to "not supported" 995618a8 Support SstFileManager::SetDeleteRateBytesPerSecond() e1916368 Add macros to include file name and line number during Logging d525718a cleanup direct io flag in WritableFileWriter 5fa927aa Add Xpress and ZSTD CompressionType values to C header 11526252 Pinnableslice (2nd attempt) e5bd8def update history.md for fixing the bug that skips keys 1ffbdfd9 Add a new SstFileWriter constructor without explicit comparator ebd5639b Add ability to search for key prefix in sst_dump tool e6725e8c Fix some bugs in MockEnv 900c62be fix compile for VS2015 fe183561 release 5.3 5dae0194 Revert "Report cpu usage using time command" f2817fb7 avoid ASSERT_EQ(false, ...); 5b11124e add max to histogram stats d43adf21 Report cpu usage using time command 18fc1bc0 minor changes for rate limiter test flakiness 12ba00ea Reset DBIter::saved_key_ with proper user key anywhere before pass to DBIter::FindNextUserEntry c9df05d1 Fix random access alignment f6499153 Add Bulkoading IngestExternalFile blog post 54b43411 Builders for partition filter 97edc72d Add a memtable-only iterator 72202962 fix db_sst_test flakiness 5f65dc87 Expose DB::DeleteRange and WriteBath::DeleteRange in Java 58b12dfe Set logs as getting flushed before releasing lock, race condition fix f8a4ea02 Move db_test and external_sst_file_test out of Travis's MAC OS run 534581a3 Fix a bug in tests in options operator= a2f7a514 Refactoring 2a5daa06 Add stderr log level for ldb backup commands 4561275c fix rate limiter test flakiness 7c80a6d7 Statistic for how often rate limiter is drained 0ad5af42 Clarify VerifyBackup behavior 6fb90134 sanitize readahead when direct read enabled f89b3893 Remove skip_table_builder_flush and default it to true cc253982 Use more default options in db_bench 8432bcf5 Make compaction_pri settable through option string d5b607a4 Make db_wal_test slightly faster ba4c77bd Divide external_sst_file_test e877afa0 Remove bulk loading and auto_roll_logger in rocksdb_lite 90d83550 Fix the wrong address for PREFETCH in DynamicBloom::Prefetch 08864df2 Move advanced column family options to advanced_options.h 2ca2059f Get unique_ptr to use delete[] for char[] in DumpMallocStats 253799c0 Add missing include for `abort()` c6d464a9 Fixed various memory leaks and Java 8 JNI Compatibility be3e5568 Fix unaligned reads in read cache 8ad0fcdf Separate small subset tests in DBTest 6c951c43 Run fewer tests in OSX f7997f13 add direct I/O to version notes 5.2.0 3b8ba703 Fix flaky DBTestUniversalCompaction.UniversalCompactionTrivialMoveTest2 96c7e150 Fix Java build e0b87afc Black list some slow valgrind tests e67232cf Handle failed Finish() in SST file writer 8efb5ffa [rocksdb][PR] Remove option min_partial_merge_operands and verify_checksums_in_comp… 1ba2804b Remove XFunc tests e7d902e6 add direct_io and compaction_readahead_size in db_stress 1ef5f50e detect logical sector size ed50308d check backup directory exists before listing children 4d7c06ce Make WriteBatchWithIndex moveble 5040414e Gracefully handle previous backup interrupted f206af56 add use_direct_io() to ReadaheadRandomAccessFile 08249344 truncate patch 286a36db posix writablefile truncate f0879e4c Page size isn't always 4k on linux 18eeb7b9 Fix interference between max_total_wal_size and db_write_buffer_size checks 1560b2f5 Temporarly return deprecated functions to fix MongoRocks build 2a0f3d0d level compaction expansion ebc8a799 alignment is on in ReadaheadRandomAccessFile::Read() 381fd322 Remove timeout_hint_us from WriteOptions fce7a6e1 Fail IngestExternalFile when bg_error_ exists a618a16f New subcode for IOError to detect the ESTALE errno 7ab00518 Remove deprecated DB::AddFile and DB::CompactRange 40166736 Adding Dlang to the list 756c5924 Allow adding external v1 sst file with no global seqno support aa0298fa Remove trailing whitespace from examples Makefile db2b4eb5 avoid direct io in rocksdb_lite 43e9f01c Fix repair_test on ROCKSDB_LITE 7106a994 Use monotonic time points in write_controller.cc and rate_limiter.cc c2247dc1 Make DBImpl::has_unpersisted_data_ atomic eb912a92 Remove disableDataSync option 0227c16d Update static library versions and add checksums b3aae4d0 Add repair_test to make check 421ce7c2 Add support for JNI Library on Linux on PowerPC. 9afa20cf Increase build version and HISTORY.md for releasing 5.2 a5adda06 Fix repair issues b48e4778 Consolidate file cutting logic in compaction loop ac2a77a7 Announce the experimetnal two-level index feature in HISTORY.md c4a37dcb Print the missed last layer in cfstats a12818af Blog post for 5.1.2 release 3b4ac807 Clarify ldb column family argument d70ce7ee Move db_bench flags out of unnamed namespace 186c7eed Remove incorrect statistics warning 53bb0151 [rocksdb][PR] compaction_style and compaction_pri should output their value as a st… 69d5262c Two-level Indexes 0a4cdde5 Windows thread 1aaa898c Adding GetApproximateMemTableStats method 9fc23c55 Use gcc-4.9-glibc-2.20-fb python in precommit_checker b797e421 Dump compression dictionary meta-block 036d668b Fix wrong result in data race case related to Get() 574b543f Rename merger.h -> merging_iterator.h add8b50c Move ThreadLocal implementation into .cc 71d2496a Fix arc setting for Facebook internal tools f289d9f4 Fix OSX build break after the fallocate change 4a3e7d32 Change the default of delayed slowdown value to 16MB/s 0513e21f RangeSync() should work with ROCKSDB_FALLOCATE_PRESENT not set 8b369ae5 Cleaner default options using C++11 in-class init ec79a7b5 Dedup code in option.cc and db_options.cc b96372de improving the C wrapper 04c4ec41 Change corruption_test to use 4 bits. 2d75cd40 NewLRUCache() to pick number of shard bits based on capacity if not given f25f1ec6 Add test DBTest2.GetRaceFlush which can expose a data race bug 37d4a79e Deserialize custom Statistics object in db_bench 3b35134e Avoid cache lookups for range deletion meta-block 94a0c32e Fix LRU Ref() for handles with external references only 17c11806 Generalize Env registration framework 07dddd5f EnvPosixTestWithParam should wait for all threads to finish 5dad9d6d Avoid logs_ operation out of DB mutex a7b13919 Fix CompactFiles() bug when used with CompactionFilter using SuperVersion 616a1464 Fix DeleteRange including sentinels in output files c918c4b7 Update USERS.md add user Pika 03ca2ac8 Remove function from DBImpl that are not used anywhere b0029bc7 Test merge op covered by range deletion in memtable d438e1ec Test range deletion block outlives table reader fba726e5 Version librocksdb.so 9da4d542 Range deletions unsupported in tailing iterator f2b4939d fixed typo 973f1b78 memtable: delete merge value for range deleteion aebfd170 fix non-portable behavior in encoder 753ff84a Fix get approx size d7ea44f2 Fixup a couple of builds errors on Linux. 537da370 c: allow set savepoint to writebatch af6ec4d7 fix batchresult handle leak e29bb934 Zlib 1.2.8 is no longer available, switched to 1.2.10 5ac97314 Fix std::out_of_range when DBOptions::keep_log_file_num is zero 4e35ffdf cmake: check -momit-leaf-frame-pointer before using it 3c0852d1 Make ingest external file backward compatible 0e8dfd60 Fix OptimizeForPointLookup() e840213d Change DB::GetApproximateSizes for more flexibility needed for MyRocks 9239103c Flush job should release reference current version if sync log failed da54d36a Disable IngestExternalFile in ReadOnly mode 5cf176ca Fix for 2PC causing WAL to grow too large 4a73bb0b Split travis jobs c70d3c7a Enable DBTest.GroupCommit as it runs in a reasonlable time now. 602c13a9 Remove fadvise with direct IO read f9d18e22 Fix DeleteRange file boundary correctness issue with max_compaction_bytes 3ce091fd Add KEEP_DB env var option 77b48066 Fix 2PC with concurrent memtable insert e8a09600 util/thread_local.h: silence a clang-build warning 324a0f98 Follow up for DirectIO refactor bc5d7b70 travis: For linux, do all tests under gcc 3e6899d1 change UseDirectIO() to use_direct_io() d4e07a84 fix warning of unused direct io helper functions dc2584ee direct reads refactor d18dd2c4 Abort compactions more reliably when closing DB 62384ebe Guarding extra fallocate call with TRAVIS because its not working pro… 9f246298 Performance: Iterate vector by reference fe395fb6 Allow incrementing refcount on cache handles 2172b660 Fix build on FreeBSD 3c233ca4 Fix Windows environment issues 76317345 Fix the error in ColumnFamiliesTest 7a02ad07 Update travis to ubuntu trusty 60c509ff Fix valgrind failure in test CurrentFileModifiedWhileCheckpointing2PC d0ba8ec8 Revert "PinnableSlice" 54d94e9c PinnableSlice e04480fa Fix MS warnings. Use ROCKSDB_Prsz for size_t. c081f721 5.0.1 release blog post ac73d755 Add GetSupportedCompressions() convenience function b104b878 Maintain position in range deletions map 640d7248 Update db_bench and sst_dump to test with block cache mid-point inser? 653ac1f9 C API: support total_order_mode 85ac1a32 Fix rocksdb::Status::getState 76711b6e Make ExternalSSTFileTest::CompactionDeadlock more deterministic c963460d Fix tests under GCC_481 33c86d67 Fix backupable db test e425ec11 utilities/backupable: backup should limit the copy size of wal. 0712d541 Delegate Cleanables d58ef52b Allow SstFileWriter to Fadvise the file away from page cache 17a4b75c Always fsync the file after file copying 2fb70dc7 examples: Add options_file_example to target all a738af8f db/pinned_iterators_manager.h: bugfix 906523d9 Add description to the 2PC checkpooint bug in HISTORY.md 438f22bc Fix bug of Checkpoint loses recent transactions with 2PC 335981d4 Fix the directory path for RocksDB repo 548b6280 Enable conditionally using adaptive mutexes 4e07b08e include/rocksdb/utilities/env_librados: fix typo ab48c165 Print cache options to info log 972f96b3 direct io write support 989e644e Remove sst_file_manager option from LITE 1beef656 Fix c_test 3d692822 persistent_cache: fix two timer 046099c9 The array is malloced by backtrace_symbols(), and must be freed 6ff2c8d7 Remove gflags as travis build dependency 3cd9ed1c Show sandcastle URL in phabricator 50e305de Collapse range deletions 5d1457db Dump persistent cache options 7bd725e9 db_bench: introduce --benchmark_read_rate_limit 29669184 Update Netflix section of USERS.md 342370f1 Simplify MemTable::Update 1a136c1f Expose file size fbff4628 Reduce compaction iterator status checks bd6cf7b5 WritableFileWriter: default buffer size equal min(64k,options.writabl? fc0c6fd9 "make format" format diff since last commit from master 816c1e30 gcc-7 requires include <functional> for std::function c2707358 Iterator should be in corrupted status if merge operator return false a8bf4d63 Make format shows wrong curl command for retrieving clang-format-diff.py 8f5d24ae C API: support get usage and pinned_usage for cache 0ab6fc16 Gcc-7 buffer size insufficient b7239bf7 Gcc 7 fallthrough 477b6ea5 std::remove_if requires <algorithm> 83f9a6fd Fail BackupEngine::Open upon meta-file read error a79eae4b Add pcache documentation images d71e728c Print user collected properties in sst_dump 7004a6f7 Add missing copyright header 3cdfaeca Fixes for MSVC compilation e097222e util/logging.cc: buffer of insufficient size (gcc-7 -Werror=format-length) cfc34d7c Missing break in case in DBTestBase::CurrentOptions bfbcec23 Gcc 7 error expansion to defined 6653e32a build: make it easier to pass PORTABLE 67adc937 intentional fallthough (prevents gcc-7/clang-4 error) 1a146f89 break Flush wait for dropped CF c3e5ee71 util/histogram.cc: HistogramStat::toString buffer insufficient 5334d8b4 table/block_based_table_builder.cc: intentional fallthrough - comment to match gcc pattern 36d42e65 Disable test to unblock travis build b57dd926 C API: support writebatch delete range 2ba59b5a Disallow ingesting files into dropped CFs 1f6f7e3e cast to signed char in ldb_cmd_test for ppc64le 243975d5 More accurate error status for BackupEngine::Open f0c509e2 Return finer-granularity status from Env::GetChildren* dc64f46b Add db_bench option for stderr logging 2cabdb8f Increase buffer size 4a17b47b Remove unnecessary header include 8c2b921f Fixed a crash in debug build in flush_job.cc 20ce081f Fix issue where IngestExternalFile insert blocks in block cache with g_seqno=0 5241e0db fix db_bench argument type c04f6a0b Specify shell in makefile 45c7ce13 CompactRangeOptions C API 2c2ba682 db_stress support for range deletions b821984d DeleteRange read path end-to-end tests 2f4fc539 Compaction::IsTrivialMove relaxing 1dce75b2 Update USERS.md 304b3c70 Update USERS.md fa50fffa Option to expand range tombstones in db_bench c26a4d8e Fix compile error in trasaction_lock_mgr.cc ed8fbdb5 Add EventListener::OnExternalFileIngested() event 2005c88a Implement non-exclusive locks 0b0f2357 Mention IngestExternalFile changes in HISTORY.md 23db48e8 Update HISTORY.md for 5.0 branch beb36d9c Fixed CompactionFilter::Decision::kRemoveAndSkipUntil 67f37cf1 Allow user to specify a CF for SST files generated by SstFileWriter 9053fe2a Made delete_obsolete_files_period_micros option dynamic edde954e fix clang build 56281f3a Add memtable_insert_with_hint_prefix_size option to db_bench 4a21b140 Cache heap::downheap() root comparison (optimize heap cmp call) e39d0808 Fix travis (compile for clang < 3.9) 3f407b06 Kill flashcache code in RocksDB b77007df Bug: paralle_group status updated in WriteThread::CompleteParallelWorker 247d0979 Support for range skips in compaction filter 96fcefbf c api: expose option for dynamic level size target 00197cff Add C API to set base_backgroud_compactions 5b219ecc deleterange end-to-end test improvements for lite/robustness aad11917 pass rocksdb oncall to mysql_mtr_filter otherwise tasks get created w… e3335289 DeleteRange write path end-to-end tests 7784980f Fix mis-reporting of compaction read bytes to the base level 3c6b49ed Fix implicit conversion between int64_t to int b3b87565 Remove unused assignment in db/db_iter.cc 4f6e89b1 Fix range deletion covering key in same SST file a2bf265a Avoid intentional overflow in GetL0ThresholdSpeedupCompaction 52fd1ff2 disable UBSAN for functions with intentional -ve shift / overflow 1886c435 Fix CompactionJob::Install division by zero 63c30de8 fix options_test ubsan 13e66a8f Fix compaction_job.cc division by zero 01eabf73 Fix double-counted deletion stat 7ffb10fc DeleteRange compaction statistics 236d4c67 Less linear search in DBIter::Seek() when keys are overwritten a lot cd7c4143 Improve Write Stalling System dfb6fe67 Unified InlineSkipList::Insert algorithm with hinting 3068870c Making persistent cache more resilient to filesystem failures 734e4aca Eliminate redundant cache lookup with range deletion 182b940e Add WriteOptions.no_slowdown 4118e133 Persistent Cache: Expose stats to user via public API f2a8f92a rocks_lua_compaction_filter: add unused attribute to a variable 4444256a Remove use of deprecated LZ4 function 548d7fb2 Fix fd leak when using direct IOs fd43ee09 Range deletion microoptimizations 23a18ca5 Reword support a little bit to more clear and concise 481856ac Update support to separate code issues with general questions a0deec96 Fix deadlock when calling getMergedHistogram fe349db5 Remove Arena in RangeDelAggregator e63350e7 Use more efficient hash map for deadlock detection a13bde39 Skip ldb test in Travis 73843aa6 Direct I/O Reads Handle the last sector correctly. 9d60151b Implement PositionedAppend for PosixWritableFile 3f622152 Lazily initialize RangeDelAggregator's map and pinning manager 41e77b83 cmake: s/STEQUAL/STREQUAL/ c1038d28 Release RocksDB 5.0 635a7bd1 refactor TableCache Get/NewIterator for single exit points f39452e8 Fix heap use after free ASAN/Valgrind a4eb7387 Allow plain table to store index on file with bloom filter disabled 36e4762c Remove Ticker::SEQUENCE_NUMBER 86eb2b9a Fix src.mk 0765babe Remove LATEST_BACKUP file 647eafdc Introduce Lua Extension: RocksLuaCompactionFilter 760ef68a fix deleterange asan issue 327085b7 fix valgrind 715591bb Ask travis to use JDK 7 972e3ff2 Enable allow_concurrent_memtable_write and enable_write_thread_adaptive_yield by default 420bdb42 option_change_migration_test: force full compaction when needed 1543d5d9 Report memory usage by memtable insert hints map. 018bb2eb DeleteRange support for db_bench dc51bd71 CMakeLists.txt: FreeBSD has jemalloc as default malloc 48e8baeb Decouple data iterator and range deletion iterator in TableCache 4b0aa3c4 Fix failed compaction_filter_example and add it into make all 53b693f5 ldb support for range delete 661e4c92 DeleteRange unsupported in non-block-based tables 489d1428 DeleteRange interface eba99c28 Fix min_write_buffer_number_to_merge = 0 bug 2ef92fea Remove all instances of relative_url until GitHub pages problem is fixed. 91300d01 Dynamic max_total_wal_size option ec2f6479 Consider subcompaction boundaries when updating file boundaries for range deletion 800e5155 Fix CSS issues again b952c898 Parallize persistent_cache_test and transaction_test 3b192f61 Handle full final subcompaction output file with range deletions 6c579520 Make range deletion inclusive-exclusive 425210cc CSS issues are arising on the Github Pages side. Temp fix. 1ea79a78 Optimize sequential insert into memtable - Part 1: Interface df5eeb85 Optimize sequential insert into memtable - Part 2: Implementation 5ed65085 Fix SstFileWriter destructor adb665e0 Allowed delayed_write_rate option to be dynamically set. 307a4e80 sst_dump support for range deletion 361010d4 Exporting compaction stats in the form of a map 672300f4 Use relative Urls for stylesheets b39b2ee1 do not call get() in recovery mode 1ca5f6d1 Fix 2PC Recovery SeqId Miscount e095d0cb Rocksdb contruns to new Sandcastle API 14c0380e Convenience option to parse an internal key on command line c90fef88 fix open failure with empty wal 4e20c5da Store internal keys in TombstoneMap a9fb346e Fix RocksDB Lite build failure in c_test.cc d133b08f Use correct sequence number when creating memtable 144cdb8f 16384 as e.g .value for compression_max_dict_bytes 9bd191d2 Fix deadlock between (WriterThread/Compaction/IngestExternalFile) a9fae0a9 CSS problems again :( 193221e0 Fix Forward Iterator Seek()/SeekToFirst() e48f3f8b remove tabs and duplicate #include in c api 85bd8f51 Minor fix to GFLAGS usage in persistent cache a7875272 c: support seek_for_prev 0f17f927 Make the header links a bit more flexible cf19f559 single quotes in feed 2dc019e0 Fix header links f1aedda0 More Jekyll 3.3 fixes c54cdc37 More Jekyll 3.3 updates 2bcaf824 Update product and feature template for Jekyll 3.3 24bceb09 Java API - Implement GetFromBatch and GetFromBatchAndDB in WBWI 815f54af Insert range deletion meta-block into block cache 9e7cf346 DeleteRange user iterator support 5c5d01ae Fix wrong comment (Maximum supported block size) f998c979 DeleteRange Get support 879f3663 Add C api for RateLimiter 557034f3 Remove all instances of baseurl 437942e4 Add avoid_flush_during_shutdown DB option 2b16d664 Change max_bytes_for_level_multiplier to double 16fb0443 expose IngestExternalFile to c abi ce22ea99 Fix casts for MSVC 196af035 Introduce FAIL_ON_WARNINGS CMake variable (default ON) 40a2e406 DeleteRange flush support d5555d95 Fix MSVC compile error in 32 bit compilation da61f348 Print compression and Fast CRC support info as Header level f9eb5679 db_bench: --dump_malloc_stats takes no effect 6a4faee5 fix freebsd build include path err and so & jar file name c90c48d3 Show More DB Stats in info logs 1b295ac8 DBTest.GetThreadStatus: Wait for test results for longer 25f5742f Update documentation to point at gcc 4.8 b50a81a2 Add a test for tailing_iterator 04751d53 L0 compression should follow options.compression_per_level if not empty 2946cadc Improve RangeDelAggregator documentation 0a9fd05c Update Vagrant file (test internal phabricator workflow) fcd1e0bf Make rocksdb work with internal repo 0aab5e55 FreeBSD: malloc_usable_size is in <malloc_np.h> (#1428) 9c0bb7f1 cmake: drop "-march=native" from CXX_FLAGS (#1429) eeb27e1b Add handy option to turn on direct I/O in db_bench (#1424) c6168d13 removed some declarations from c.h which resulted in undefined symbols (#1407) bc429de4 revert fractional cascading in farward iterator b9bc7a2a Use skiplist rep for range tombstone memtable 60a2bbba Makefile: generate util/build_version.cc from .in file (#1384) 9ee84067 Disable DBTest.RepeatedWritesToSameKey (#1420) f41df304 OptionChangeMigration() to support FIFO compaction 2e8004e6 Changing the legocastle run to use valgrind_test instead of _check 9de2f752 revert Prev() in MergingIterator to use previous code in non-prefix-seek mode 24495186 DBSSTTest.RateLimitedDelete: not to use real clock 1168cb81 Fix a bug that may cause a deleted row to appear again 99c052a3 Fix integer overflow in GetL0ThresholdSpeedupCompaction (#1378) f83cd64c Fix a bug that mistakenly disable regression_test.sh to update commit (#1415) 0e926b84 Passing DISABLE_JEMALLOC=1 to valgrind_check if run locally 4dfaa661 Make IsDeadlockDetect() virtual member of Transaction 59a7c033 Change ioptions to store user_comparator, fix bug 869ae5d7 Support IngestExternalFile (remove AddFile restrictions) 1d9dbef6 Restrict running condition of UniversalCompactionTrivialMoveTest2 4edd39fd Implement deadlock detection 48fd619a Minor fixes to RocksJava Native Library initialization (#1287) 48e4e842 Disable auto compactions in memory_test and re-enable the test (#1408) fb2e4129 column_family_test: disable some tests in LITE 5af651db fix data race in compact_files_test a0ba0aa8 Fix uninitialized variable gcc error for MyRocks b88f8e87 Support SST files with Global sequence numbers [reland] 08616b49 [db_bench] add filldeterministic (Universal+level compaction) 52c9808c not split file in compaciton on level 0 5e0d6b4c fix db_stress assertion failure ab539983 Bump RocksDB version to 4.13 (#1405) b4d07123 SamePrefixTest.InDomainTest to clear the test directory before testing aa09d033 Avoid calling GetDBOptions() inside GetFromBatchAndDB() 6fbe96ba Compaction Support for Range Deletion 257de78d Remove "-Xcheck:jni" from Java tests (#1402) d88dff4e add seeforprev in history 5027dd17 Fix a minor bug in the ldb tool that was not selecting the specified (#1399) fea6fdd6 Fix @see in two Java functions (#1396) b1031d6c Remove function local statics that interfere with memory pooling (#1392) f4705401 Handle WAL deletion when using avoid_flush_during_recovery e29d3b67 Make max_background_compactions and base_background_compactions dynamic changeable 21e8dace fix assertion failure in Prev() b9311aa6 Implement WinRandomRW file and improve code reuse (#1388) a249a0b7 check_format_compatible.sh to use some branch which allows to run with GCC 4.8 (#1393) 040328a3 Remove an assertion for single-delete in MergeHelper::MergeUntil 8cbe3e10 Relax the acceptable bias RateLimiterTest::Rate test be 25% f26a139d Log successful AddFile 5691a1d8 Fix compaction conflict with running compaction 017de666 fixup commit 1b7af5fb Redo handling of recycled logs in full purge 27bfe327 Editorial change to README.md 89cc404d A bit of doc restructuring 9e7fda82 Fix arcanist 2e4b5cab Add missing RateLimiter class to the Windows build (#1382) ce4963fd [doc] Document that Visual Studio 2015+ is now required for Windows builds (#1389) e4892709 Fix scoped arena iterator (#1387) f8d8cf53 Fix log_write_bench -bytes_per_sync option. (#1375) 02b3e398 Make txn->GetState() const 447f1712 new Prev() prefix support using SeekForPrev() 991b585e More block cache tickers d6ae6dec Add Statistics::getAndResetTickerCount(). aea3ce4c Avoid string CONCAT which is not supported in cmake 2.6 (#1383) 2ad68b97 Support running consistency checks in release mode 67501cfc Fix -ve std::string::resize 04b02dd1 Testing asset links after config change 8c55bb87 Make Lock Info test multiple column families d0623289 Revert "Support SST files with Global sequence numbers" 5cd28833 [RocksJava] Adjusted RateLimiter to 3.10.0 (#1368) 37737c3a Expose Transaction State Publicly 2c1f9529 Add facility to write only a portion of WriteBatch to WAL 043cb62d Fix record_size in log_write_bench, swap args to std::string::assign. (#1373) 4985f60f env_mirror: fix a few leaks (#1363) 5aded67d update of c.h (#1371) 912aec13 "Recent Posts" -> "All Posts" 7cbb298d Make sure that when contribtuing we call out creating appropriate directories a06ad471 Add top level doc information to CONTRIBUTING.md 3fdd5b97 A little more generic CONTRIBUTING.md ed4fc31d Add link to CONTRIBUTING.md to main docs README.md e4922e18 Forgot to truncate one blog post 6d8cd7ed Add CONTRIBUTING.md for rocksdb.org contribution guidance bd55e5a1 Fix some formatting of compaction blog post 0f60358b CRLF -> LF mod (including removing trailing whitespace for those files) b90e29c9 Truncate posts on the main /blog/ page 0d7acada Add author fields to blog posts 01be4418 Add GitHub link to the landing page header 9d6c9613 Fix Mac build ab01da54 Support SST files with Global sequence numbers d346ba24 Minor fixes around Windows 64 Java Artifacts (#1366) e91b4d0c Add factory method for creating persistent cache that is accessible from public be1f1092 Expose transaction id, lock state information and transaction wait information 6009c473 Store range tombstones in memtable 3c21c64c Use size hint for HashMap in multiGet. Similar to https://github.com/facebook/rocksdb/pull/1344 (#1367) 13f7a01f Fixing JNI release build for gcc (#975) 7260662b Add Java API for SstFileWriter 26388247 delete unused variable for PrevInterval() 87dfc1d2 Fix conflict between AddFile() and CompactRange() eb44ed65 Update 2016-09-28-rocksdb-4-11-2-released.markdown e4437610 Update 2016-09-28-rocksdb-4-11-2-released.markdown 501f0510 Update 2016-09-28-rocksdb-4-11-2-released.markdown dec9009f Update 2016-09-28-rocksdb-4-11-2-released.markdown 4ed69dd0 Create 2016-09-28-rocksdb-4-11-2-released.markdown 21f4bb5a cmake support for linux and osx (#1358) 4defe306 fix typo in comments (#1360) f517d9dd Add SeekForPrev() to Iterator eb3894cf Recompute compaction score on SetOptions (#1346) 5c64fb67 Fix AddFile() conflict with compaction output [WaitForAddFile()] 9e9f5a0b Fix CompactFilesTest.ObsoleteFiles timeout (#1353) c2a62a4c not cut compaction output when compact to level 0 9ed928e7 Split DBOptions into ImmutableDBOptions and MutableDBOptions 4bc8c88e Recover same sequence id from WAL (#1350) 0a1bd9c5 add cfh deletion started listener da5a9a65 Fix mac build d45eb6c6 Fix typo (#1349) abc0ae46 Add AddFile() InternalStats for Total files/L0 files/total keys ingested 71525633 forbid merge during recovery 5735b3dc Fix compiling under -Werror=missing-field-initializers 654ed9a2 loose the assertion condition of rate_limiter_test e4d3f5d9 Fix DBImpl::GetWalPreallocateBlockSize Mac build error 7afbb742 solve the problem of table_factory_to_write_=nullptr (#1342) d78a4401 DBImpl::GetWalPreallocateBlockSize() should return size_t 42ac9c5f Retry getting arcanist token on failure b666f854 Consider more factors when determining preallocation size of WAL files 4c3f4496 Add TableBuilderOptions::level and relevant changes (#1335) 3edb9461 Avoid hard-coded sleep in EnvPosixTestWithParam.TwoPools 0a88f38b Remove ColumnFamilyData::options() 41a9070f Fix java makefile dependencies 8d9bf5c4 Fix DBOptionsTest.GetLatestOptions 40cfa3e0 Fix DBWALTest.RecoveryWithLogDataForSomeCFs with mac 06b4785f Fix recovery for WALs without data for all CFs d7242ff4 Fix GetSortedWalFiles when log recycling enabled 17f76fc5 DB::GetOptions() reflect dynamic changed options 215d1282 Fix typo (#903) a958c264 Rename jvalue to jval in rocksjni 0a165bd7 Have Facebook link point to RocksDB on FB 3639f328 Fix bug in UnScSigned-off-by: xh931076284 <931076284@qq.com> (#1336) 8e061f97 Refactor GetMutableOptionsFromStrings 81747f1b Refactor MutableCFOptions ba65c816 Support POSIX RandomRWFile 1d980a8e Create CNAME 2adab1dd Add API links to the header bar a182b298 Preserve blog comments in markdown f54de923 Adding Dgraph to list of Users (#1291) 9e4aa798 Summary: (#1313) a10e8a05 Fix C api memtable rep bugs. (#1328) eb1d4d53 Release RocksDB 4.12 22d88e24 Allow an offset as well as a length to be specified for byte[] operations in RocksJava JNI (#1264) b06b1913 add C api for set wal_recovery_mode (#1327) 1cca0912 Temporarily revert Prev() prefix support de28a255 Update HISTORY.md for thread-local stats 0fcb6dbe Remove extraneous function prototypes from c.h (#1326) 52ee07b0 Move AddFile() tests to external_sst_file_test.cc 66a91e26 Add NoSpace subcode to IOError (#1320) 67036c04 Fix Flaky ColumnFamilyTest.FlushCloseWALFiles 0e2da497 fix typo in option.h's comment (#1321) 6d61358a Add real Google Analytics ID 2d9d36ea Have "Edit on GitHub" point to master instead of gh-pages 93775189 Update landing page content 1ec75ee7 Add redirects from old blog posts link to new format 607628d3 Support ZSTD with finalized format ce1be2ce Fix build error on Windows (AppVeyor) (#1315) f7669b40 Fix Windows Build 22696b08 Fix uninitlized CompactionJob::SubcompactionState::current_output_file_size c1865e0f Trigger more tests per diff a88677d2 Remove ImmutableCFOptions from public API 80c75593 Fix data race in AddFile() with multiple files + custom comparator bug 5051755e Fix db_bench memory use after free (detected by clang_analyze) 4fd08f4b Ensure Correct Behavior of StatsLevel kExceptDetailedTimers and kExceptTimeForMutex (#1308) e14fbaae Add FAQ based on the front page of the current rocksdb.org 3c226240 Migrate the RocksDB Worpdress blog over to Jekyll ee0e2201 Transfer the current Getting Started contents to GitHub Pages 5a0e9a4c Initial Landing Page 9447a854 Remove the `doc` directory 32149059 Merge options source_compaction_factor, max_grandparent_overlap_bytes and expanded_compaction_factor into max_compaction_bytes 4590b53a add stats to Cache::LookUp() 85bb3082 Expose Utility function StringToMap() (#1306) 8ce1b844 Fix Travis on Mac 380e651a Fix Mac build failure (#1309) 1613fa94 Thread-specific histogram statistics 6a14d55b add prefix_seek_mode to db_iter_test de47e2bd Fix ClockCache memory leak f099af4c Fix travis db74b1a2 fix bug in merge_iterator when data race happens b18f9c9e add nullptr check to internal_prefix_transform 4e395e87 Update docs README.md 2482d5fb support Prev() in prefix seek mode 7541c7a7 Fix cache_test valgrind_check failure c8513cde Update the download location of Snappy (#1304) b49b92cf Introduce Read amplification bitmap (read amp statistics) c7004840 store prefix_extractor_name in table 4ad928e1 add comment to SimCache to estimate actual capacity e9b2af87 Expose ThreadPool under include/rocksdb/threadpool.h 23a05700 Document memtable flush behavior in CancelAllBackgroundWork() dade61ac Mitigate regression bug of options.max_successive_merges hit during DB Recovery cce702a6 [db_bench] Support single benchmark arguments (Repeat for X times, Warm up for X times), Support CombinedStats (AVG / MEDIAN) 3586901f cat tests logs sorted by exit code b2ce5953 Persist data during user initiated shutdown 4b3438d2 Fix parallel valgrind (valgrind_check) a081f798 Relax consistency for thread-local ticker stats b10d65c2 Update and slightly clarify instructions in build_detect_platform (#1301) f85f99bf Fix the Windows build of RocksDB Java. Similar to https://github.com/facebook/rocksdb/issues/1220 (#1284) 7b810951 Fix a crash when compaction fails to open a file 7c958683 Thread-specific ticker statistics ea9e0757 Add initial GitHub pages infra for RocksDB documentation move and update. (#1294) 2a9c9710 [Flaky Test] Disable DBPropertiesTest.GetProperty d76ddf32 Disable ClockCache db_crashtest cec2c643 fix data race in NewIndexIterator() in block_based_table_reader.cc badbff65 Not insert into block cache if cache is full and not holding handle 4a16c32e Option to cache index/filter blocks with priority 99c4af71 Make ClockCache available with TSAN build f57bc1d0 Fix lambda expression for clang/windows 5440675c Fix lambda capture expression for windows 6584cec8 Fold function for thread-local data 817eeb29 Add singleDelete to RocksJava (#1275) ffdf6eee Add Status to RocksDBException so that meaningful function result Status from the C++ API isn't lost (#1273) ecf90038 Fix bug in printing values for block-based table 72f8cc70 LRU cache mid-point insertion 6a17b07c Add TablePropertiesCollector support in SstFileWriter 78837f5d TableBuilder / TableReader support for range deletion 4cc37f59 Introduce ClockCache ff17a2ab Adding TBB as dependency. 49d88be0 c abi: allow compaction filter ignore snapshot (#1268) 0b63f51f fixes 1215: execute_process(COMMAND mkdir ${DIR}) fails to create a directory with cmake on Windows (#1219) 3981345b Small nits (#1280) 2a2ebb6f Move LRUCache structs to lru_cache.h header 2fc2fd92 Single Delete Mismatch and Fallthrough statistics 3771e379 WriteBatch support for range deletion 236756f2 Make SyncPoint return immediately when disabled 64a0082c Fix DBSSTest::AddExternalSstFileSkipSnapshot valgrind fail dd7a748c Fix java build 4fe12baa Make db_bench less space for --stats_per_interval 6525ce4c Compaction stats printing: "batch" => "commit group" a117891b Fixed typo (#1279) b248e98c Fix a destruction order issue in ThreadStatusUpdater deda159b Added min/max/avg data block size output to sst_dump e408e98c add Name() to Cache a297643f Fix valgrind memory leak d11c09d9 Eliminate memcpy from ForwardIterator d3675550 Added further Java API options for controlling concurrent writes ebdfe34c Exposed further Java API options for controlling compaction d1be5946 Improve documentation of SliceTransform. 6056d631 Improve comment and bug fix for GetOptionsFromMap functions in convenience.h 76a67cf7 support stackableDB as the baseDB of transactionDB 67c1ae88 Travis build break fix b693ba68 Minor PinnedIteratorsManager Refactoring db3dfb16 Fixes for arcanist config (#1271) 87c91bd8 Persistent Read Cache (8) Benchmark tooling 2914de64 add sim_cache stats to Statistics 8b79422b [Proof-Of-Concept] RocksDB Blob Storage with a blob log file. 4beffe00 Fix test data race in two FaultInjectionTest tests 821bcb0b util/arena.cc: FreeBSD: More portable use of mmap(MAP_ANON) (#1254) 5370f44a Increase RocksDB version 56dd0341 read_options.background_purge_on_iterator_cleanup to cover forward iterator and log file closing too. ccecf3f4 UniversalCompaction should ignore sorted runs being compacted (when compacting for file num) 1b0069ce Remove non-gtest from parallelized tests 638c49f2 Change HISTORY.md for release 4.11 6b8e9c68 fix vs generator (#1269) c38b075e Update HISTORY.md 8f399e3f Update HISTORY.md 98d0b78e Added check_snapshot option in the DB's AddFile function (#1261) 9fd68b7f set travis open file descriptor limit 59ddb505 Fix travis build break f4d98636 Added SetOptions support to RocksJava (#1243) 7882cb97 Make DBOptionsTest::EnableAutoCompactionAndTriggerStall less falky 44f5cc…

andresilva added 3 commits December 13, 2017 13:03

Merge commit '9e7edc8dfd98c526b4786935817dbf1d077eabf1'

20ba63b

fix rocksdb-sys build

21233c8

andresilva mentioned this pull request Dec 20, 2017

Upgrade to RocksDB 5.8.8 and tune settings to reduce space amplification openethereum/parity-ethereum#7348

Merged

tomusdrw merged commit 166e14e into master Dec 29, 2017

tomusdrw deleted the rocksdb-5.8.8 branch December 29, 2017 10:15

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Upgrade to RocksDB 5.8.8 #10

Upgrade to RocksDB 5.8.8 #10

andresilva commented Dec 13, 2017

andresilva commented Dec 13, 2017

Upgrade to RocksDB 5.8.8 #10

Upgrade to RocksDB 5.8.8 #10

Conversation

andresilva commented Dec 13, 2017

andresilva commented Dec 13, 2017