Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Squashed 'src/rocksdb2/' changes from 1fdd726a8..aead40417
aead40417 fix HISTORY.md typo a0cdc3cec Bump version to 5.8.7 7513f6350 Fix IOError on WAL write doesn't propagate to write group follower 9e47084ce Bump version to 5.8.6 36074ba5d Enable cacheline_aligned_alloc() to allocate from jemalloc if enabled. aa00523e0 Add -DPORTABLE=1 to MSVC CI build cf2b98237 Bump version to 5.8.5 e8c9350f2 Blob DB: not using PinnableSlice move assignment 4907d2463 Bump version to 5.8.4 5d928c795 Blob DB: Fix race condition between flush and write 725bb9d66 Blob DB: Fix release build b7367fe84 Bump version to 5.8.3 13b2a9b6f Blob DB: use compression in file header instead of global options 5dc70a15c Fix PinnableSlice move assignment 9019e9125 dynamically change current memtable size 7f1815c37 Bump version to 5.8.2 2584a18ef Blob DB: Fix BlobDBTest::SnapshotAndGarbageCollection asan failure 17f67b546 PinnableSlice move assignment 6fb56c582 Blob DB: Add compaction filter to remove expired blob index entries f90ced92f Blob DB: fix snapshot handling 632f36dcd Blob DB: option to enable garbage collection 11bacd578 Blob DB: Fix flaky BlobDBTest::GCExpiredKeyWhileOverwriting test f98efcb1e Blob DB: Evict oldest blob file when close to blob db size limit c1e99eddc Blob DB: cleanup unused options ffc3c62ca Blob DB: Initialize all fields in Blob Header, Footer and Record structs 9e8254090 Blob DB: update blob file format d66bb21e1 Blob DB: Inline small values in base DB 05d5c575a Return write error on reaching blob dir size limit 2b8893b9e Blob DB: Store blob index as kTypeBlobIndex in base db 419b93c56 Blob DB: not writing sequence number as blob record footer 8afb0036c fix lite build dded348dd Blob DB: Move BlobFile definition to a separate file 374736123 add GetLiveFiles and GetLiveFilesMetaData for BlobDB 8cff6e945 Enable WAL for blob index c29347290 Add ValueType::kTypeBlobIndex eae53de3b Make it explicit blob db doesn't support CF 65aec19df Fix memory leak on blob db open 30b38c98c TableProperty::oldest_key_time defaults to 0 2879f4beb Bump version to 5.8.1 88595c882 Add DB::Properties::kEstimateOldestKeyTime 266ac245a Bumping version to 5.8 64185c23a update HISTORY.md for DeleteRange bug fix e83d6a02e Not using aligned_alloc with gcc4 + asan 0980dc6c9 Fix wrong smallest key of delete range tombstones b76797231 avoid use-after-move error c41744270 CMake: Fix formatting c21ea8f7a CMake: Add support for CMake packages 544434558 add Erlang to the list of language bindings 2972a702a Minor updates to FlushWAL blog fbfa3e7a4 WriteAtPrepare: Efficient read from snapshot list b01f426f5 Blog post for FlushWAL 503db684f make blob file close synchronous 3c840d1a6 Allow DB reopen with reduced options.num_levels 92bfd6c50 Fix DropColumnFamily data race 7fdf735d5 Pinnableslice examples and blog post 7fbb9ecca support disabling checksum in block-based table 19cc66dc4 fix clang bug in block-based table reader 7eba54eb9 test compaction input-level split range tombstone assumption cd26af347 Add unit test for WritePrepared skeleton a12479819 Improved transactions support in C API c10b39131 LANGUAGE-BINDINGS.md: add another rust binding 90177432e Remove leftover references to phutil_module_cache 234f33a3f allow nullptr Slice only as sentinel ccf7f833e Use PinnableSlice in Transactions 1dfcdb15f Extend pin_l0 to filter partitions 39ef90055 stop calling memcmp with nullptrs 78cb6b611 Provide byte[] version of SstFileWriter.merge to reduce GC Stall 867fe92e5 Scale histogram bucket size by constant factor f004307e9 CMake improvements 09ac6206a Circumvent ASAN false positive 5b68b114f Blob db create a snapshot before every read 4624ae52c GC the oldest file when out of space 8ace1f79b add counter for deletion dropping optimization 0d8e992b4 Revert the mistake in version update 5358a8056 add VerifyChecksum to HISTORY.md ed0a4c93e perf_context measure user bytes read 1efc600dd Preload l0 index partitions bddd5d363 Added mechanism to track deadlock chain c1384a707 fix db_stress uint64_t to int32 cast 29877ec7b Fix blob db crash during calculating write amp 8f2598ac9 Enable Cassandra merge operator to be called with a single merge operand 9a44b4c32 Allow merge operator to be called even with a single operand ac8fb77af fix some misspellings 23593171c minor improvements to db_stress af012c0f8 fix deleterange with memtable prefix bloom 1c8dbe2aa update scores after picking universal compaction eb6425303 Update WritePrepared with the pseudo code 132306fbf Remove PartialMerge implementation from Cassandra merge operator 71598cdc7 Fix false removal of tombstone issue in FIFO and kCompactionStyleNone 3204a4f64 Fix missing stdlib include required for abort() 7aa96db7a db_stress rolling active window dfa6c23c4 Update RocksDBCommonHelper to use escapeshellarg e367774d1 Overload new[] to properly align LRUCacheShard ad42d2fcb Remove residual arcanist_util directory 279296f4d properly set C[XX]FLAGS during CMake configure-time checks c5f0c6cc6 compile with correct flags to determine SSE4.2 support 185ade4c0 cmake: support more compression type 5449c0990 rocksdb: make buildable on aarch64 a144a9782 Fix for CMakeLists.txt on Windows for RocksJava acf935e40 fix deletion dropping in intra-L0 8254e9b57 make sst_dump compression size command consistent 74f18c130 db_bench support for non-uniform column family ops 5de98f2d5 approximate histogram stats to save cpu 3f5888430 Fix c_test ASAN failure e5a1b727c Fix blob DB transaction usage while GC 6f051e0c7 fix corruption_test valgrind ac098a462 expose set_skip_stats_update_on_db_open to C bindings 666a005f9 Support prefetch last 512KB with direct I/O in block based file reader ad77ee0ea Revert "Makefile: correct faligned-new test" b87ee6f77 Use more keys per lock in daily TSAN crash test 25df24254 Add column families related functions (C API) 64f848435 block_cache_tier: fix gcc-7 warnings 0cecf8155 Write batch for `TransactionDB` in C API 6a9de4347 Windows.h macro call fix 23c7d1354 fix comment 1fbad84b6 Makefile: correct faligned-new test 7848f0b24 add VerifyChecksum() to db.h 47ed3bfc3 fix WinEnv assertions d97a72d63 Try to repair db with wal_dir option, avoid leak some WAL files 36375de76 gcc-7/i386: markup intentional fallthroughs bdc056f8a Refactor PessimisticTransaction a9a4e89c3 Fix valgrind complaint about initialization 4ca11b4b0 Update USERS.md c9804e007 Refactor TransactionDBImpl 20dc5e74f Optimize range-delete aggregator call in merge helper. 0d4a2b733 Avoid blob db call Sync() while writing 627c9f1ab Don't add -ljemalloc when DISABLE_JEMALLOC is set dce6d5a83 db_bench background work thread pool size arguments 4f81ab38b Makefile: fix for GCC 7+ and clang 4+ 92afe830f Update all blob db TTL and timestamps to uint64_t 5883a1ae2 Fix /bin/bash shebangs cc01985db Introduce bottom-pri thread pool for large universal compactions 0b814ba92 Allow concurrent writes to blob db 2c45ada4c Blob DB garbage collection should keep keys with newer version 58410aee4 Fix the overflow bug in AwaitState c3d5c4d38 Refactor TransactionImpl 060ccd4f8 support multiple CFs with OPTIONS file 345387067 Fix statistics in RocksJava sample 1900771bd Dump Blob DB options to info log 3218edc57 Fix universal compaction bug 6a36b3a7b fix db get/write stats a84cee812 Add a missing "once" in .h 21696ba50 Replace dynamic_cast<> e85f2c64c Prevent empty memtables from using a lot of memory ac748c57e Fix FIFO Compaction with TTL tests aaf42fe77 Move blob_db/ttl_extractor.h into blob_db/blob_db.h aace46516 Fix license headers in Cassandra related files 50a969131 CacheActivityLogger, component to log cache activity into a file 6083bc79f Blob DB TTL extractor 710411aea fix asan/valgrind for TableCache cleanup 3a3fb00b7 TARGETS file not setting sse explicitly fca4d6da1 Build fewer tests in Travis platform_dependent tests 8f553d3c5 remove unnecessary internal_comparator param in newIterator 7f6d012d7 "ccache -C" in Travis d12691b86 move TableCache::EraseHandle outside of db mutex f33f11368 fix db_bench argument type e7697b8ce Fix LITE unit tests 3ce20e985 Fix use of RocksDBCommonHelper in cont_integration.sh c281b4482 Revert "CRC32 Power Optimization Changes" 9980de262 Fix FIFO compaction picker test 2289d3811 CRC32 Power Optimization Changes 30b58cf71 Remove the orphan assert on !need_log_sync fe1a5559f Fix flaky write_callback_test addbd279c 5.6.1 release blog post 30edff308 buckification: remove explicit `-msse*` compiler flags 2b259c9d4 Lower num of iterations in DeadlockCycle test 277f6f23d Release note for partitioned index/filters 5e731a138 Remove unused rocksdb arcanist lib 9b11d4345 Fix broken links 06f191744 add vcpkg as an windows option ea8ad4f67 Fix compaction div by zero logging 34112aeff Added db paths to c 1d8aa2961 Gcc 7 ParsedInternalKey replace memset with clear function. a4c42e800 Fix UBSAN issue of passing nullptr to memcmp 16e038820 LRUCacheShard cache line size alignment 216644c61 enable UBSAN macro in TARGETS e67b35c07 Add Iterator::Refresh() a34b2e388 Fix caching of compaction picker's next index 72502cf22 Revert "comment out unused parameters" 1d7048c59 comment out unused parameters 534c255c7 Cassandra compaction filter for purge expired columns and rows 63163a8c6 Remove make_new_version.sh 0302da47a Reduce blob db noisy logging 3e5ea29a8 Fix Flaky DeleteSchedulerTest::ImmediateDeleteOn25PercDBSize a22b9cc6f overlapping endpoint fixes in level compaction picker ffd2a2eef delete ExpandInputsToCleanCut failure log 3e6e863b1 Remove arcanist_util directory 36651d14e Moving static AdaptationContext to outside function 6e3ee015f Update java/rocksjni.pom ecff9d5e3 Include write_buffer_manager in ImmutableDBOptions::Dump ae28634e9 Remove some left-over BSD headers 33b1de82a Remove format compatibility hack 2f375154e checkout local branch in check_format_compatible.sh ddb22ac59 avoid collision with master branch in check format 0c03a7f17 set the remote for git checkout 7ac184c6d Revert cmake -DNDEBUG for non-MSVC 0655b5858 enable PinnableSlice for RowCache 00464a314 Fix column_family_test with LITE build b2dd192fe tools/write_stress.cc: Correct "1204" typos. cbaab3044 table/block.h: change memset f1a056e00 CodeMod: Prefer ADD_FAILURE() over EXPECT_TRUE(false), et cetera 4a2e4891f Add back the LevelDB license file a7321fc97 Remove the licensing description in CONTRIBUTING.md 3c327ac2d Change RocksDB License 132013366 Make TARGETS file portable ccf5f08f8 Set CACHE_LINE_SIZE for s390, PPC, ARM64 67510eeff db_crashtest.py: remove need for shell 4267eb00d Remove punit tests 5bfb67d90 Enable write rate limit for updaterandom benchmark 20a691d98 Update HISTORY to release 5.7 98d1a5510 db_bench to by default verify checksum 26ce69b19 Update blob db to use ROCKS_LOG_* macro 43e4eef77 remove unnecessary fadvise 21b17d768 Fix BlobDB::Get which only get out the value offset 70440f7a6 Add virtual func IsDeleteRangeSupported 7550255c5 Add JAVAC_ARGS as Makefile variable 7a0b5de77 Gcc 7 ignored quantifiers 000bf0af3 Improve the design and native object management of Stats in RocksJava 269d383d5 Bump version to 5.7 c32f27223 Fixes db_bench with blob db fcd99d27c db_bench_tool: fix buffer size 87128bd5c fix regression test 8f927e5f7 Fix undefined behavior in Hash 643b787c7 Added a note about LZ4 compression dependency 56656e12d Temporarily disable FIFOCompactionWithTTLTest b5fb85ec5 fix valgrind init complaint 657df29ea Add max_background_jobs to db_bench a43c053ad remove duplicated utilities/merge_operators/cassandra/test_utils.cc in src.mk 7c4a9e6c9 Initialize a variable in ldb to make code analysis tool happy 98669b535 init filters_in_partition_ 0013bf14e fix asan and valgrind leak report in test 521b4c28b rocksdb 5.5.1 release post 33042573d Fix GetCurrentTime() initialization for valgrind f6b9d9355 Fix clang error in PartitionedFilterBlockBuilder 45b9bb033 Cut filter partition based on metadata_block_size f4ae1bab0 update history for OnBackgroundError and DeleteRange fix 1cb8c6de6 Add -enable_pipelined_write to db_bench and add two defaults 7604b463b Update the AddDBStats in LITE 1e34d07e1 Simplify and document sync rules for logs_ etc d310e0f33 Regression test for empty dedicated range deletion file e9f91a517 Add a fetch_add variation to AddDBStats c1b375e96 skip generating empty sst 67b417d62 fix format compatible test afbef6518 Bug fix: Fast CRC Support printing is not honest 397ab1115 Improve Status message for block checksum mismatches 18c63af6e Make "make analyze" happy 01534db24 Fix the reported asan issues 1cd45cd1b FIFO Compaction with TTL 982cec22a Fix TARGETS file tests list b49b37109 allow numa >= 2.0.8 e517bfa2c CLANG Tidy dc3d2e4d2 update compatible test 89468c01d Fix Windows build broken by 5c97a7c0664d4071768113814e9ba71fe87e18cf 51778612c Encryption at rest support 7061912c2 Trivial typo in HISTORY.md 2a9cd8799 Fix jni WriteBatchThreadedTest 0025a3640 revert perf_context and io_stats to __thread 5c97a7c06 Unit Tests for sync, range sync and file close failures 4cee11f4e Intra-L0 blog post 857e9960b Improve the error message for I/O related errors. d757355cb Fix bug that flush doesn't respond to fsync result 8e6345d2d Update rename of ParanoidCheck 499ebb3ab Optimize for serial commits in 2PC 0ac4afb97 Sanitize partitioning options 521724ba8 fixed wrong type for "allow_compaction" parameter 71f5bcb73 Introduce OnBackgroundError callback 88cd2d96e Downgrade option sanitiy check level for prefix_extractor 6837a1762 Fix Data Race Between CreateColumnFamily() and GetAggregatedIntProperty() af1746751 WriteBufferManager will not trigger flush if much data is already being flushed 9467eb614 Fix flush assertion with tsan 048446fc7 Fix cassandra ASAN use-after-free a21db161c Implement ReopenWritibaleFile on Windows and other fixes c430d69ee fix coredump for release nullptr 0d278456c default implementation for InRange cbd825dee Create a MergeOperator for Cassandra Row Value 2c98b06bf Remove pin_slice option by making it the default c80c6115d add db_bench options for partitioning 6a3377f45 Synchronize statistic enumeration values between statistics.h and java API 53dda8797 Do not run RateLimiterTest.Rate test on Travis+Mac OSX. ae8571f5c Fix blob db compression bug 7a380deff Update blob_db_test 89ad9f3ad Allow ignoring unknown options when loading options from a file 6b5a5dc5d fixed typo 0f228be3b fixed typo in util/dynamic_bloom.h c217e0b9c Call RateLimiter for compaction reads 91e2aa3ce write exact sequence number for each put in write batch 6f4154d69 record index partition properties 5d5a28a98 Fix Clang release build broken by 5582123dee8426a5191dfd5e846cea8c676c793c 0175d58c3 Make direct I/O write use incremental buffer 7a270069b GNU C library for struct tm has 2 additional fields. d713471da Limit trash directory to be 25% of total DB 9bb91e932 Dedup release 27b450165 Update HistogramTypes in the Java API e97304c68 update history for 5.6 5582123de Sample number of reads per SST file db818d2d1 Fix RocksDB Lite build with CLANG a472c4ae4 update 5.5 change log bc09c8a0d Fix crash in PosixWritableFile::Close() when fstat() fails 6d0f22e42 Fix mock_env.cc uninitialized variable c2012d488 Java APIs for put, merge and delete in file ingestion 85dace2af Disable DBRangeDelTest::TailingIteratorRangeTombstoneUnsupported for ubsan d4f7731b6 fix travis error with init time in mockenv 550a1df72 Fix clang errors by asserting the precondition cc5f9339e Fix concurrency issue with filter_block_set_ 2e64f450d bump version to 5.6 afbc2d0d2 Force travis to build with clang on MacOS b172a3f1a Fix warnings while generating RocksJava documentation 52a7f38b1 WriteOptions.low_pri which can throttle low pri writes if needed 26a8a8071 Switch from CentOS 5 to CentOS 6 for crossbuilding RocksJava dba9f3722 Fix db_write_test clang/windows build failure c7662a44a fixed typo 7e8d95cc0 Fix the Java build which was broken by a4d9c02 7e5fac2c3 remove test dir before exit when current regression is running 7f6c02dda using ThreadLocalPtr to hide ROCKSDB_SUPPORT_THREAD_LOCAL from public… 138b87eae Fix interaction between CompactionFilter::Decision::kRemoveAndSkipUnt… 95b0e89b5 Improve write buffer manager (and allow the size to be tracked in block cache) a4d9c0251 Pass CF ID to MemTableRepFactory f68d88be5 Fix DBWriteTest::ReturnSequenceNumberMultiThreaded data race 215076ef0 Fix TSAN: avoid arena mode with range deletions 3a8a848a5 account for L0 size in estimated compaction bytes 0fae3f5dd codemod: format TARGETS with buildifier [5/5] (D5092623) 872199606 add checkpoint support for single db in regression test 5a9b4d743 Retire memenv https://github.com/facebook/rocksdb/pull/2082 d6019651b sync internal/external TARGETS bbaba51bb Add missing index type to C-API 292edfd51 travis: test with xcode8.3 (OS X 10.12) 0dc3040d5 db: avoid `#include`ing malloc and jemalloc simultaneously 9b3ed8350 fix regression test 9c9909bf7 Support ingest file when range deletions exist ad19eb868 Fixing blob db sequence number handling 51ac91f58 Histogram of number of merge operands 345878a7f update blob_db_test cbc821c25 change regression rebuild to one level 103d0692e Avoid unsupported attributes when not building with UBSAN 5fd04566c travis: reduce the number of travis builders 2d05002b9 RocksDB 5.4.5 release blog post 7eca90f18 Update RocksDB blog authors d03c34497 update comment of GetNextFile f7bb1a006 support merge and delete in file ingestion c2c62ad4e Reorder variables of ReadOptions 7bb1f5d48 Increase of compaction threads should be logged at info level instead of a warning 6c456ecae Clean zstd files 347e16f83 codemod: replace `headers = AutoHeaders.*` with `auto_headers` 0be636bf7 Fix db_bench build break with blob db 135ee6a3f fix tsan crash data race a99fb9928 fix column_family_test asan f41bffb3d travis: clang-3.6 -> clang-4.0 e7612798b update buckifer/TARGETS bb01c1880 Introduce max_background_jobs mutable option 5a2530462 Fix the CMakeLists for RocksJava 41cbb7274 options.delayed_write_rate use the rate of rate_limiter by default. 506803466 range sync should be enabled 02594b5f1 Fix build errors in blob_dump_tool with GCC 4.8 52d9e5f7b Fix column family seconds_up accounting 7d8207f1f Fix errors in clang-analyzer builds 85b8569ae Fix release build on Linux 69ec8356b Allow SstFileWriter to use the rate limiter 6cc9aef16 New API for background work in single thread pool 9d0a07ed5 Fix rocksdb.estimate-num-keys DB property underflow 578fb0b1d Simple blob file dumper ac39d6bec Core-local statistics 3e86c0f07 disable direct reads for log and manifest and add direct io to tests 15ba4d6c4 Address MS Visual Studio 2017 issue with autovector 88c818e43 Replace deprecated RocksDB#addFile with RocksDB#ingestExternalFile 228f49d20 Fix data races caught by tsan 4c9d2b104 remove #include port/port.h in public header file 07bdcb91f New WriteImpl to pipeline WAL/memtable write d746aead1 Suppress clang-analyzer false positive 217b866f4 column_family_test: EnvCounter::num_new_writable_file_ to be atomic 9f839a7f6 keep util/build_version.cc when make clean 7eecd40a4 add emacs tags file - etags 9bbba4fec Remoe unused BlockBasedTable::compaction_optimized_ f5ba131bf Fixed some spelling mistakes 146b7718f Fix mingw compilation with -DNDEBUG a36220ccf fix unity test 0ebdd7057 fixed typo 8032f4cb3 Remove -pie in TSAN 362ba9b02 Release RocksDB 5.5.0 ba685a472 Support ingest_behind for IngestExternalFile 01ab7b528 Add ROCKSDB_LIBRARY_API macro to a few C APIs, to fix windows build cb9392a09 add Transactions and Checkpoint to C API 445f1235b s/std::snprintf/snprintf cd593c283 Fix travis java_test f720796e2 fixed typo a48a62d5b define NDEBUG in CMake non-debug builds 1ca723dbd C API: support pinnable get 2ef15b85d Core-local stats blog post 4f9e69ccf fix log err 11c5d4741 cross-platform compatibility improvements d00433302 Put lib files into suitable path in RPM package 86d549253 Fix build error with blob DB. 254c46800 Fix the RocksJava Release on Windows 7a47b431f Fix .gitignore pattern fa5a15ceb Make sure that zstd is statically linked correctly in the Java static build 3fa9a39c6 Add GetAllKeyVersions API 1a60982a5 Simplified instructions for CentOS a5cc7ecec Facility for cross-building RocksJava using Docker ccd3dddf5 Blog post for partitioned index/filters b145c34d7 Update blog authors bbe9ee7dd core-local array type conversions c2be43430 Build and link with ZStd when creating the static RocksJava build c61e72c42 Add missing files of blob_db to CMake file 3907c94ff Fix ColumnFamilyTest:BulkAddDrop cda5fde2d CoreLocalArray class 93949667c update TARGETS 4e83b8001 title: Bulkoading -> title: Bulkloading d85ff4953 Blob storage pr 492fc49a8 fix readampbitmap tests be421b0b1 portable sched_getcpu calls 0f559abdb Add NO_UPDATE_BUILD_VERSION option to makefile 3a04a254a Flink state 35df23fe8 Fix suite exclisions e7cea86f7 Fixes the CentOS 5 cross-building of RocksJava 259a00eac unbiase readamp bitmap a62096696 port: updated PhysicalCoreID() df035b682 Print compaction_options_universal.stop_style in LOG file 4897eb250 dont skip IO for filter blocks 3f73d54bb Add C API to set max_file_opening_threads option 0b69e5079 Define CACHE_LINE_SIZE only when it's not defined 2cd00773c Add bulk create/drop column family API 40af2381e Object lifetime in cache fdaefa030 travis: add Windows cross-compilation a30a69603 do not read next datablock if upperbound is reached 2d42cf5ea Roundup read bytes in ReadaheadRandomAccessFile 264d3f540 Allow IntraL0 compaction in FIFO Compaction 8c3a180e8 Set lower-bound on dynamic level sizes 7c1c8ce5a Avoid calling fallocate with UINT64_MAX a45e98a5b max_open_files dynamic set, follow up 6b99dbe04 fix memory alignment with logical sector size e7ae4a3a0 Max open files mutable 60847a3b0 port: updated PhysicalCoreID() b551104e0 support PopSavePoint for WriteBatch 498693cf3 Remove orphaned Java classes 5e2ebf2bd travis: add CMake compilation af6fe69e4 Fix an issue of manual / auto compaction data race 6798d1f3b Revert "Delete filter before closing the table" 89833577a Delete filter before closing the table 47a09b0a8 Avoid pinning when row cache is accessed aeaba07b2 Remove an assert that causes TSAN failure. 0b90aa951 Set VALGRIND_VER a2b05210e Make PosixLogger::flush_pending_ atomic da4b2070b Fix WriteBatchWithIndex address use after scope error d616ebea2 Add GPLv2 as an alternative license. 4439b4596 Add documentation license 0ca3ead0c add GetRootDB() in DeleteFilesInRange cdad04b05 Remove double buffering on RandomRead on Windows. e15382c09 Disable two flaky tests 2150cc1f3 fix WritableFile buffer size in direct IO efc361ef7 Add user stats Reset API 6616e4d62 add prefetch to PosixRandomAccessFile in buffered io f6a27d0bc Extract statistics tests into separate file 7eddecce1 support bulk loading with universal compaction 3b4d1b7a4 add <sys/sysmacros.h> to avoid warning with glibc 2.25 e5e545a02 Reunite checkpoint and backup core logic 72c21fb3f call GetRootDB() before cast to DBImpl* in CancelAllBackgroundWork 4c9447d88 Add erase option to release cache 04d58970c AIX and Solaris Sparc Support afff9951e Respect deprecated flag in table options 066cfbacc Adding -noprofile to CMakeLists for Windows cb885bccf set compaction_iterator earliest_snapshot to max if no snapshot 7534ba7bd StackableDB should pass ResetStats() c1fbf91b2 Fixing Solaris Sparc crash due to cached TLS 963eeba48 Revert how check_format_compatible.sh checkout release branches. 97005dbd5 tools/check_format_compatible.sh to cover option file loading too 8f6196788 Add cpu usage to regression benchmarks (4th attempt) df74b775e Limit backups opened 1dd776051 Change L0 compaction score using level size 927bbab25 Revert "Add cpu usage to regression benchmarks (3rd attempt)" 8e84a388e Re-add index_per_partition but as deprecated 1553659d6 Add more recent versions to tools/check_format_compatible.sh 966ebb02f Hide event listeners from lite build 476e80be8 Add cpu usage to regression benchmarks (3rd attempt) c49d70465 Add DB:ResetStats() 0fcdccc33 Blob storage helper methods a6439d797 CMake: compile with -O2 e67f0adf3 enable O2 optimization for lz4 bc3973259 CMake: add support for SSE4.2 7d5f5aa97 Separate compile and link for shared library 071652734 remove warning 6e8d6f429 readahead backwards from sst end ca96654d8 Change Build Env to gcc-5 e9e6e5324 Simplify write thread logic 6799c7e00 Pass in remote as a param to branch creation script 44fa8ece9 change use_direct_writes to use_direct_io_for_flush_and_compaction 13b50358f add space for buggy kernel warning b6b9359ec Fix BYTES_WRITTEN accounting 13369fbd4 Update ShipIt to honor TARGETS updates f2449ce92 Remove .deprecated_arcconfig 415be221c RocksDB Release 5.4 : Update HISTORY.md and build version. 3eab41d7c java dependencies test -s -> use test -d a22ed4eab internal_repo_rocksdb to build Java and RocksDB LITE 9f2cc59ec sync TARGETS file 10d754696 set readahead buffer size from roundup(user_size) + 4k to roundup(use… ba7da434a fix db_stress crash caused by buggy kernel warning 6257837d8 Add ROCKSDB_JAVA_NO_COMPRESSION flag 6a6723ee1 Move MergeOperatorPinning tests to be with other merge operator tests 6a8d5c015 Revert "Report cpu usage using time command" 8f47a9751 File level histogram should be printed per CF, not per DB 9300ef545 Fix shared lock upgrades 1f8b119ed Limit maximum memory used in the WriteBatch representation 97ec8a134 Report cpu usage using time command 20778f2f9 Adding comments to the write path 7124268a0 Reduce the number of params needed to construct DBIter 04abb2b2d FreeBSD only requires WITH_JEMALLOC, not the rest 61730186d dummy diff 360e9960f Summary: Remove .arcconfig 69a5e6461 Deprecate .arcconfig 9690653db Add a verify phase to benchmarks dd8f9e38e Fix compilation for GCC-5 c2954f9b6 Add Travis job to build examples 72fc1e9d0 avoid non-existent O_DIRECT on OpenBSD ff9728701 Refactor compaction picker code 9e7293902 only FALLOC_FL_PUNCH_HOLE when ftruncate is buggy 343b59d6e Move various string utility functions into string_util 1d068f606 Fix CompactRange incorrect buffer release df6f5a377 Move memtable related files into memtable directory 107c5f6a6 CMake: more MinGW fixes d2dce5611 Move some files under util/ to separate dirs c50e3750d Use a human readable size for level report ce64b8b71 Divide db/db_impl.cc 02799ad77 Revert "delete fallocate with punch_hole" e2a7b202c Release note for partition filters af256eb2b build db every monday e5a1372b2 Rework test running script. d659faad5 Level-based L0->L0 compaction a12306fab Add a notice on gflags installation in INSTALL.md 43010a929 Revert "[rocksdb][PR] CMake: more MinGW fixes" a30b75cdc Add buckifier script to github repo 3450ac8c1 CMake: more MinGW fixes 90cfd4645 update IterKey that can get user key and internal key explicitly e2c6c0636 add TimedEnv 9e4453180 Refactor WriteImpl (pipeline write part 1) 6ef8c620d Move auto_roll_logger and filename out of db/ a1c469d71 Add release notes for PinnableSlice 0537f515c fix run_remote with strong quoting 72e600094 fixed misses on Centos library installation instructions 88cc81df5 auto_roll_logger_test to move away from real sleep d25e28d58 replace sometimes-undefined uint type with unsigned int a1d7e487b Add L0 write-amp to compaction level stats b6d609063 CMake: support AVX2 in MinGW bd7d13835 test remote instead run remote in regression test c81a805fe test db existence on the remote host 5fc1e6765 add -rf when remove db in regression test 4ab4049f2 gflags has moved to GitHub 4e0065015 make all DB::Get overloads virtual 6401a8b76 Fix build with MinGW 80fe5b385 disable test: DeleteSchedulerTest.DynamicRateLimiting1 a9c86f51b backup garbage collect shared_checksum tmp files da175f7ec exit with code 2 when there is already a db_bench running in regression test 0ee7f0403 Added missing options to RocksJava c6d04f2ec Option to fail a request as incomplete when skipping too many internal keys 58179ec4a Cleanup of ThreadStatusUtil structures should use the DB's reference f3607640a add ldb build to regression test 8a8c96746 Enable Fast CRC32 for Win64 f9813b853 Added SstFileWriter construtor without explicit comparator to JNI api 8d3cb4f20 Added naming of backup engine threads 67d762379 Expose the stalling information through DB::GetProperty() 0fd574926 delete fallocate with punch_hole 41fe9ad75 Hide usage of compaction_options_fifo from lite build e7731d119 Configure index partition size 69c8d524a Fix jni library name for PowerPC Architecture 34a70859b Fix segmentation fault caused by #1961 8dee8cad9 Enable fifo compaction benchmark to db_bench a5c8b5434 fix a header include 91b5feb37 Fix Windows Build broken by a recent commit 41ccae6d2 Add C API functions (and tests) for WriteBatchWithIndex 88bb6f6bf non_shm CI should run tests on /tmp 8888de2b1 Update .gitignore file in examples 203136e79 Fix Compilation errors when using IBM Java f4fce4751 Fix clang compile error - [-Werror,-Wunused-lambda-capture] a084b26a5 Blog post for releasing 5.2.1 15950fe3a Remove ASSERT_EQ(boolean, ...) 3e56c7e0c make total_log_size_ atomic 909028e21 HISTORY.md for log_size_for_flush in CreateCheckpoint() be723a8d8 Optionally construct Post Processing Info map in MemTableInserter e474df947 db_bench: not need to check mmap for PlainTable 8b0097b49 Readers for partition filter 9ef3627fd Allow checkpointing without flushing 17866ecc3 Allow Users to change customized ldb tools' header in help printing a2a883318 remove deleted option from benchmark.sh 78cb19559 add checkpoint to ldb 4b04addfc updated solution if "make format" command fails 8f5bf0446 Flush triggered by DB write buffer size picks the oldest unflushed CF 6908e24b5 dynamic setting of stats_dump_period_sec through SetDBOption() 93c68b642 change regression bash file with debug mode 21d8c3179 remove LIKELY from public headers 36ad75778 INSTALL: document USE_SSE 9272e12f1 avoid ftruncate twice in buffered io d52f334cb Break stalls when no bg work is happening e66221add fix db_bench rate limiter callsites dbae438a0 Replace "DEPRECATED" comment to "not supported" 995618a82 Support SstFileManager::SetDeleteRateBytesPerSecond() e19163688 Add macros to include file name and line number during Logging d525718a9 cleanup direct io flag in WritableFileWriter 5fa927aa9 Add Xpress and ZSTD CompressionType values to C header 11526252c Pinnableslice (2nd attempt) e5bd8def1 update history.md for fixing the bug that skips keys 1ffbdfd9a Add a new SstFileWriter constructor without explicit comparator ebd5639b6 Add ability to search for key prefix in sst_dump tool e6725e8c8 Fix some bugs in MockEnv 900c62be6 fix compile for VS2015 fe1835617 release 5.3 5dae01947 Revert "Report cpu usage using time command" f2817fb7f avoid ASSERT_EQ(false, ...); 5b11124e3 add max to histogram stats d43adf21b Report cpu usage using time command 18fc1bc0e minor changes for rate limiter test flakiness 12ba00ea6 Reset DBIter::saved_key_ with proper user key anywhere before pass to DBIter::FindNextUserEntry c9df05d1e Fix random access alignment f64991537 Add Bulkoading IngestExternalFile blog post 54b434110 Builders for partition filter 97edc72d3 Add a memtable-only iterator 72202962f fix db_sst_test flakiness 5f65dc877 Expose DB::DeleteRange and WriteBath::DeleteRange in Java 58b12dfe3 Set logs as getting flushed before releasing lock, race condition fix f8a4ea020 Move db_test and external_sst_file_test out of Travis's MAC OS run 534581a35 Fix a bug in tests in options operator= a2f7a514d Refactoring 2a5daa06f Add stderr log level for ldb backup commands 4561275c2 fix rate limiter test flakiness 7c80a6d7d Statistic for how often rate limiter is drained 0ad5af42d Clarify VerifyBackup behavior 6fb901344 sanitize readahead when direct read enabled f89b3893c Remove skip_table_builder_flush and default it to true cc253982d Use more default options in db_bench 8432bcf55 Make compaction_pri settable through option string d5b607a43 Make db_wal_test slightly faster ba4c77bd6 Divide external_sst_file_test e877afa08 Remove bulk loading and auto_roll_logger in rocksdb_lite 90d835507 Fix the wrong address for PREFETCH in DynamicBloom::Prefetch 08864df21 Move advanced column family options to advanced_options.h 2ca2059f6 Get unique_ptr to use delete[] for char[] in DumpMallocStats 253799c06 Add missing include for `abort()` c6d464a9d Fixed various memory leaks and Java 8 JNI Compatibility be3e5568b Fix unaligned reads in read cache 8ad0fcdf9 Separate small subset tests in DBTest 6c951c43c Run fewer tests in OSX f7997f134 add direct I/O to version notes 5.2.0 3b8ba703c Fix flaky DBTestUniversalCompaction.UniversalCompactionTrivialMoveTest2 96c7e1504 Fix Java build e0b87afc7 Black list some slow valgrind tests e67232cff Handle failed Finish() in SST file writer 8efb5ffa2 [rocksdb][PR] Remove option min_partial_merge_operands and verify_checksums_in_comp… 1ba2804b7 Remove XFunc tests e7d902e69 add direct_io and compaction_readahead_size in db_stress 1ef5f50e8 detect logical sector size ed50308d2 check backup directory exists before listing children 4d7c06ced Make WriteBatchWithIndex moveble 5040414e6 Gracefully handle previous backup interrupted f206af56f add use_direct_io() to ReadaheadRandomAccessFile 082493442 truncate patch 286a36db7 posix writablefile truncate f0879e4c3 Page size isn't always 4k on linux 18eeb7b90 Fix interference between max_total_wal_size and db_write_buffer_size checks 1560b2f5f Temporarly return deprecated functions to fix MongoRocks build 2a0f3d0de level compaction expansion ebc8a7998 alignment is on in ReadaheadRandomAccessFile::Read() 381fd3224 Remove timeout_hint_us from WriteOptions fce7a6e19 Fail IngestExternalFile when bg_error_ exists a618a16f4 New subcode for IOError to detect the ESTALE errno 7ab005183 Remove deprecated DB::AddFile and DB::CompactRange 401667366 Adding Dlang to the list 756c5924e Allow adding external v1 sst file with no global seqno support aa0298fa9 Remove trailing whitespace from examples Makefile db2b4eb50 avoid direct io in rocksdb_lite 43e9f01c2 Fix repair_test on ROCKSDB_LITE 7106a994f Use monotonic time points in write_controller.cc and rate_limiter.cc c2247dc1c Make DBImpl::has_unpersisted_data_ atomic eb912a927 Remove disableDataSync option 0227c16d6 Update static library versions and add checksums b3aae4d07 Add repair_test to make check 421ce7c2b Add support for JNI Library on Linux on PowerPC. 9afa20cf2 Increase build version and HISTORY.md for releasing 5.2 a5adda064 Fix repair issues b48e4778b Consolidate file cutting logic in compaction loop ac2a77a74 Announce the experimetnal two-level index feature in HISTORY.md c4a37dcb4 Print the missed last layer in cfstats a12818afc Blog post for 5.1.2 release 3b4ac8076 Clarify ldb column family argument d70ce7ee0 Move db_bench flags out of unnamed namespace 186c7eedb Remove incorrect statistics warning 53bb01516 [rocksdb][PR] compaction_style and compaction_pri should output their value as a st… 69d5262c8 Two-level Indexes 0a4cdde50 Windows thread 1aaa898cf Adding GetApproximateMemTableStats method 9fc23c55f Use gcc-4.9-glibc-2.20-fb python in precommit_checker b797e4215 Dump compression dictionary meta-block 036d668b1 Fix wrong result in data race case related to Get() 574b543f8 Rename merger.h -> merging_iterator.h add8b50cc Move ThreadLocal implementation into .cc 71d2496af Fix arc setting for Facebook internal tools f289d9f4a Fix OSX build break after the fallocate change 4a3e7d320 Change the default of delayed slowdown value to 16MB/s 0513e21f9 RangeSync() should work with ROCKSDB_FALLOCATE_PRESENT not set 8b369ae5b Cleaner default options using C++11 in-class init ec79a7b53 Dedup code in option.cc and db_options.cc b96372dea improving the C wrapper 04c4ec41d Change corruption_test to use 4 bits. 2d75cd40d NewLRUCache() to pick number of shard bits based on capacity if not given f25f1ec60 Add test DBTest2.GetRaceFlush which can expose a data race bug 37d4a79e9 Deserialize custom Statistics object in db_bench 3b35134e4 Avoid cache lookups for range deletion meta-block 94a0c32e7 Fix LRU Ref() for handles with external references only 17c118060 Generalize Env registration framework 07dddd5f7 EnvPosixTestWithParam should wait for all threads to finish 5dad9d6d2 Avoid logs_ operation out of DB mutex a7b13919b Fix CompactFiles() bug when used with CompactionFilter using SuperVersion 616a1464e Fix DeleteRange including sentinels in output files c918c4b76 Update USERS.md add user Pika 03ca2ac8a Remove function from DBImpl that are not used anywhere b0029bc7f Test merge op covered by range deletion in memtable d438e1ec1 Test range deletion block outlives table reader fba726e55 Version librocksdb.so 9da4d542f Range deletions unsupported in tailing iterator f2b4939da fixed typo 973f1b78f memtable: delete merge value for range deleteion aebfd1703 fix non-portable behavior in encoder 753ff84a3 Fix get approx size d7ea44f2f Fixup a couple of builds errors on Linux. 537da370d c: allow set savepoint to writebatch af6ec4d78 fix batchresult handle leak e29bb934f Zlib 1.2.8 is no longer available, switched to 1.2.10 5ac97314e Fix std::out_of_range when DBOptions::keep_log_file_num is zero 4e35ffdfa cmake: check -momit-leaf-frame-pointer before using it 3c0852d1d Make ingest external file backward compatible 0e8dfd606 Fix OptimizeForPointLookup() e840213d6 Change DB::GetApproximateSizes for more flexibility needed for MyRocks 9239103cd Flush job should release reference current version if sync log failed da54d36a9 Disable IngestExternalFile in ReadOnly mode 5cf176ca1 Fix for 2PC causing WAL to grow too large 4a73bb0b4 Split travis jobs c70d3c7ad Enable DBTest.GroupCommit as it runs in a reasonlable time now. 602c13a96 Remove fadvise with direct IO read f9d18e22d Fix DeleteRange file boundary correctness issue with max_compaction_bytes 3ce091fd7 Add KEEP_DB env var option 77b480662 Fix 2PC with concurrent memtable insert e8a096000 util/thread_local.h: silence a clang-build warning 324a0f988 Follow up for DirectIO refactor bc5d7b702 travis: For linux, do all tests under gcc 3e6899d11 change UseDirectIO() to use_direct_io() d4e07a845 fix warning of unused direct io helper functions dc2584eea direct reads refactor d18dd2c41 Abort compactions more reliably when closing DB 62384ebe9 Guarding extra fallocate call with TRAVIS because its not working pro… 9f246298e Performance: Iterate vector by reference fe395fb63 Allow incrementing refcount on cache handles 2172b660e Fix build on FreeBSD 3c233ca4e Fix Windows environment issues 763173456 Fix the error in ColumnFamiliesTest 7a02ad070 Update travis to ubuntu trusty 60c509ff1 Fix valgrind failure in test CurrentFileModifiedWhileCheckpointing2PC d0ba8ec8f Revert "PinnableSlice" 54d94e9c2 PinnableSlice e04480fae Fix MS warnings. Use ROCKSDB_Prsz for size_t. c081f7215 5.0.1 release blog post ac73d7558 Add GetSupportedCompressions() convenience function b104b8781 Maintain position in range deletions map 640d72480 Update db_bench and sst_dump to test with block cache mid-point inser? 653ac1f9c C API: support total_order_mode 85ac1a320 Fix rocksdb::Status::getState 76711b6e7 Make ExternalSSTFileTest::CompactionDeadlock more deterministic c963460db Fix tests under GCC_481 33c86d677 Fix backupable db test e425ec116 utilities/backupable: backup should limit the copy size of wal. 0712d541d Delegate Cleanables d58ef52ba Allow SstFileWriter to Fadvise the file away from page cache 17a4b75cc Always fsync the file after file copying 2fb70dc79 examples: Add options_file_example to target all a738af8f8 db/pinned_iterators_manager.h: bugfix 906523d98 Add description to the 2PC checkpooint bug in HISTORY.md 438f22bc5 Fix bug of Checkpoint loses recent transactions with 2PC 335981d47 Fix the directory path for RocksDB repo 548b62805 Enable conditionally using adaptive mutexes 4e07b08ef include/rocksdb/utilities/env_librados: fix typo ab48c165a Print cache options to info log 972f96b3f direct io write support 989e644ed Remove sst_file_manager option from LITE 1beef6569 Fix c_test 3d692822f persistent_cache: fix two timer 046099c9b The array is malloced by backtrace_symbols(), and must be freed 6ff2c8d7f Remove gflags as travis build dependency 3cd9ed1c3 Show sandcastle URL in phabricator 50e305de9 Collapse range deletions 5d1457dbb Dump persistent cache options 7bd725e96 db_bench: introduce --benchmark_read_rate_limit 296691847 Update Netflix section of USERS.md 342370f1d Simplify MemTable::Update 1a136c1f1 Expose file size fbff4628a Reduce compaction iterator status checks bd6cf7b51 WritableFileWriter: default buffer size equal min(64k,options.writabl? fc0c6fd98 "make format" format diff since last commit from master 816c1e30c gcc-7 requires include <functional> for std::function c27073586 Iterator should be in corrupted status if merge operator return false a8bf4d63f Make format shows wrong curl command for retrieving clang-format-diff.py 8f5d24ae6 C API: support get usage and pinned_usage for cache 0ab6fc167 Gcc-7 buffer size insufficient b7239bf7e Gcc 7 fallthrough 477b6ea57 std::remove_if requires <algorithm> 83f9a6fd2 Fail BackupEngine::Open upon meta-file read error a79eae4b0 Add pcache documentation images d71e728c7 Print user collected properties in sst_dump 7004a6f7b Add missing copyright header 3cdfaeca3 Fixes for MSVC compilation e097222e6 util/logging.cc: buffer of insufficient size (gcc-7 -Werror=format-length) cfc34d7c4 Missing break in case in DBTestBase::CurrentOptions bfbcec233 Gcc 7 error expansion to defined 6653e32ac build: make it easier to pass PORTABLE 67adc937b intentional fallthough (prevents gcc-7/clang-4 error) 1a146f89c break Flush wait for dropped CF c3e5ee715 util/histogram.cc: HistogramStat::toString buffer insufficient 5334d8b44 table/block_based_table_builder.cc: intentional fallthrough - comment to match gcc pattern 36d42e65d Disable test to unblock travis build b57dd9262 C API: support writebatch delete range 2ba59b5a1 Disallow ingesting files into dropped CFs 1f6f7e3e8 cast to signed char in ldb_cmd_test for ppc64le 243975d5d More accurate error status for BackupEngine::Open f0c509e2c Return finer-granularity status from Env::GetChildren* dc64f46b1 Add db_bench option for stderr logging 2cabdb8f4 Increase buffer size 4a17b47bb Remove unnecessary header include 8c2b921fd Fixed a crash in debug build in flush_job.cc 20ce081fa Fix issue where IngestExternalFile insert blocks in block cache with g_seqno=0 5241e0dbf fix db_bench argument type c04f6a0b4 Specify shell in makefile 45c7ce137 CompactRangeOptions C API 2c2ba6824 db_stress support for range deletions b821984d3 DeleteRange read path end-to-end tests 2f4fc539c Compaction::IsTrivialMove relaxing 1dce75b2e Update USERS.md 304b3c706 Update USERS.md fa50fffaf Option to expand range tombstones in db_bench c26a4d8e8 Fix compile error in trasaction_lock_mgr.cc ed8fbdb56 Add EventListener::OnExternalFileIngested() event 2005c88a7 Implement non-exclusive locks 0b0f23572 Mention IngestExternalFile changes in HISTORY.md 23db48e8d Update HISTORY.md for 5.0 branch beb36d9c1 Fixed CompactionFilter::Decision::kRemoveAndSkipUntil 67f37cf19 Allow user to specify a CF for SST files generated by SstFileWriter 9053fe2a5 Made delete_obsolete_files_period_micros option dynamic edde954e7 fix clang build 56281f3a9 Add memtable_insert_with_hint_prefix_size option to db_bench 4a21b1402 Cache heap::downheap() root comparison (optimize heap cmp call) e39d08087 Fix travis (compile for clang < 3.9) 3f407b065 Kill flashcache code in RocksDB b77007df8 Bug: paralle_group status updated in WriteThread::CompleteParallelWorker 247d0979a Support for range skips in compaction filter 96fcefbf1 c api: expose option for dynamic level size target 00197cff3 Add C API to set base_backgroud_compactions 5b219eccb deleterange end-to-end test improvements for lite/robustness aad119176 pass rocksdb oncall to mysql_mtr_filter otherwise tasks get created w… e33352899 DeleteRange write path end-to-end tests 7784980fc Fix mis-reporting of compaction read bytes to the base level 3c6b49ed6 Fix implicit conversion between int64_t to int b3b875657 Remove unused assignment in db/db_iter.cc 4f6e89b1d Fix range deletion covering key in same SST file a2bf265a3 Avoid intentional overflow in GetL0ThresholdSpeedupCompaction 52fd1ff2c disable UBSAN for functions with intentional -ve shift / overflow 1886c435b Fix CompactionJob::Install division by zero 63c30de80 fix options_test ubsan 13e66a8f5 Fix compaction_job.cc division by zero 01eabf737 Fix double-counted deletion stat 7ffb10fc1 DeleteRange compaction statistics 236d4c67e Less linear search in DBIter::Seek() when keys are overwritten a lot cd7c4143d Improve Write Stalling System dfb6fe675 Unified InlineSkipList::Insert algorithm with hinting 3068870cc Making persistent cache more resilient to filesystem failures 734e4acaf Eliminate redundant cache lookup with range deletion 182b940e7 Add WriteOptions.no_slowdown 4118e1333 Persistent Cache: Expose stats to user via public API f2a8f92a1 rocks_lua_compaction_filter: add unused attribute to a variable 4444256ab Remove use of deprecated LZ4 function 548d7fb26 Fix fd leak when using direct IOs fd43ee09d Range deletion microoptimizations 23a18ca5a Reword support a little bit to more clear and concise 481856ac4 Update support to separate code issues with general questions a0deec960 Fix deadlock when calling getMergedHistogram fe349db57 Remove Arena in RangeDelAggregator e63350e72 Use more efficient hash map for deadlock detection a13bde39e Skip ldb test in Travis 73843aa63 Direct I/O Reads Handle the last sector correctly. 9d60151b0 Implement PositionedAppend for PosixWritableFile 3f6221521 Lazily initialize RangeDelAggregator's map and pinning manager 41e77b839 cmake: s/STEQUAL/STREQUAL/ c1038d283 Release RocksDB 5.0 635a7bd1a refactor TableCache Get/NewIterator for single exit points f39452e81 Fix heap use after free ASAN/Valgrind a4eb7387b Allow plain table to store index on file with bloom filter disabled 36e4762ce Remove Ticker::SEQUENCE_NUMBER 86eb2b9ad Fix src.mk 0765babe1 Remove LATEST_BACKUP file 647eafdc2 Introduce Lua Extension: RocksLuaCompactionFilter 760ef68a6 fix deleterange asan issue 327085b7b fix valgrind 715591bba Ask travis to use JDK 7 972e3ff29 Enable allow_concurrent_memtable_write and enable_write_thread_adaptive_yield by default 420bdb42e option_change_migration_test: force full compaction when needed 1543d5d92 Report memory usage by memtable insert hints map. 018bb2ebf DeleteRange support for db_bench dc51bd716 CMakeLists.txt: FreeBSD has jemalloc as default malloc 48e8baebc Decouple data iterator and range deletion iterator in TableCache 4b0aa3c4c Fix failed compaction_filter_example and add it into make all 53b693f5f ldb support for range delete 661e4c926 DeleteRange unsupported in non-block-based tables 489d14280 DeleteRange interface eba99c28e Fix min_write_buffer_number_to_merge = 0 bug 2ef92fea5 Remove all instances of relative_url until GitHub pages problem is fixed. 91300d01f Dynamic max_total_wal_size option ec2f64794 Consider subcompaction boundaries when updating file boundaries for range deletion 800e51553 Fix CSS issues again b952c898b Parallize persistent_cache_test and transaction_test 3b192f618 Handle full final subcompaction output file with range deletions 6c5795200 Make range deletion inclusive-exclusive 425210cc4 CSS issues are arising on the Github Pages side. Temp fix. 1ea79a78c Optimize sequential insert into memtable - Part 1: Interface df5eeb85c Optimize sequential insert into memtable - Part 2: Implementation 5ed650857 Fix SstFileWriter destructor adb665e0b Allowed delayed_write_rate option to be dynamically set. 307a4e80c sst_dump support for range deletion 361010d44 Exporting compaction stats in the form of a map 672300f47 Use relative Urls for stylesheets b39b2ee12 do not call get() in recovery mode 1ca5f6d13 Fix 2PC Recovery SeqId Miscount e095d0cbc Rocksdb contruns to new Sandcastle API 14c0380e7 Convenience option to parse an internal key on command line c90fef88b fix open failure with empty wal 4e20c5da2 Store internal keys in TombstoneMap a9fb346e4 Fix RocksDB Lite build failure in c_test.cc d133b08f6 Use correct sequence number when creating memtable 144cdb8f1 16384 as e.g .value for compression_max_dict_bytes 9bd191d2f Fix deadlock between (WriterThread/Compaction/IngestExternalFile) a9fae0a9d CSS problems again :( 193221e0a Fix Forward Iterator Seek()/SeekToFirst() e48f3f8b9 remove tabs and duplicate #include in c api 85bd8f518 Minor fix to GFLAGS usage in persistent cache a7875272d c: support seek_for_prev 0f17f9279 Make the header links a bit more flexible cf19f559d single quotes in feed 2dc019e09 Fix header links f1aedda06 More Jekyll 3.3 fixes c54cdc378 More Jekyll 3.3 updates 2bcaf8246 Update product and feature template for Jekyll 3.3 24bceb096 Java API - Implement GetFromBatch and GetFromBatchAndDB in WBWI 815f54afa Insert range deletion meta-block into block cache 9e7cf3469 DeleteRange user iterator support 5c5d01ae7 Fix wrong comment (Maximum supported block size) f998c9790 DeleteRange Get support 879f36636 Add C api for RateLimiter 557034f36 Remove all instances of baseurl 437942e48 Add avoid_flush_during_shutdown DB option 2b16d664c Change max_bytes_for_level_multiplier to double 16fb04434 expose IngestExternalFile to c abi ce22ea99a Fix casts for MSVC 196af035c Introduce FAIL_ON_WARNINGS CMake variable (default ON) 40a2e406f DeleteRange flush support d5555d95a Fix MSVC compile error in 32 bit compilation da61f348d Print compression and Fast CRC support info as Header level f9eb56791 db_bench: --dump_malloc_stats takes no effect 6a4faee5c fix freebsd build include path err and so & jar file name c90c48d3c Show More DB Stats in info logs 1b295ac8a DBTest.GetThreadStatus: Wait for test results for longer 25f5742f0 Update documentation to point at gcc 4.8 b50a81a2b Add a test for tailing_iterator 04751d534 L0 compression should follow options.compression_per_level if not empty 2946cadc4 Improve RangeDelAggregator documentation 0a9fd05c2 Update Vagrant file (test internal phabricator workflow) fcd1e0bf6 Make rocksdb work with internal repo 0aab5e55f FreeBSD: malloc_usable_size is in <malloc_np.h> (#1428) 9c0bb7f17 cmake: drop "-march=native" from CXX_FLAGS (#1429) eeb27e1bb Add handy option to turn on direct I/O in db_bench (#1424) c6168d13a removed some declarations from c.h which resulted in undefined symbols (#1407) bc429de49 revert fractional cascading in farward iterator b9bc7a2aa Use skiplist rep for range tombstone memtable 60a2bbba9 Makefile: generate util/build_version.cc from .in file (#1384) 9ee84067f Disable DBTest.RepeatedWritesToSameKey (#1420) f41df3045 OptionChangeMigration() to support FIFO compaction 2e8004e60 Changing the legocastle run to use valgrind_test instead of _check 9de2f7521 revert Prev() in MergingIterator to use previous code in non-prefix-seek mode 24495186d DBSSTTest.RateLimitedDelete: not to use real clock 1168cb810 Fix a bug that may cause a deleted row to appear again 99c052a34 Fix integer overflow in GetL0ThresholdSpeedupCompaction (#1378) f83cd64c0 Fix a bug that mistakenly disable regression_test.sh to update commit (#1415) 0e926b84f Passing DISABLE_JEMALLOC=1 to valgrind_check if run locally 4dfaa6610 Make IsDeadlockDetect() virtual member of Transaction 59a7c0337 Change ioptions to store user_comparator, fix bug 869ae5d78 Support IngestExternalFile (remove AddFile restrictions) 1d9dbef64 Restrict running condition of UniversalCompactionTrivialMoveTest2 4edd39fda Implement deadlock detection 48fd619a4 Minor fixes to RocksJava Native Library initialization (#1287) 48e4e842b Disable auto compactions in memory_test and re-enable the test (#1408) fb2e41294 column_family_test: disable some tests in LITE 5af651db2 fix data race in compact_files_test a0ba0aa87 Fix uninitialized variable gcc error for MyRocks b88f8e87c Support SST files with Global sequence numbers [reland] 08616b493 [db_bench] add filldeterministic (Universal+level compaction) 52c9808c3 not split file in compaciton on level 0 5e0d6b4cc fix db_stress assertion failure ab5399837 Bump RocksDB version to 4.13 (#1405) b4d07123c SamePrefixTest.InDomainTest to clear the test directory before testing aa09d0338 Avoid calling GetDBOptions() inside GetFromBatchAndDB() 6fbe96baf Compaction Support for Range Deletion 257de78d9 Remove "-Xcheck:jni" from Java tests (#1402) d88dff4ef add seeforprev in history 5027dd17a Fix a minor bug in the ldb tool that was not selecting the specified (#1399) fea6fdd67 Fix @see in two Java functions (#1396) b1031d6c1 Remove function local statics that interfere with memory pooling (#1392) f47054015 Handle WAL deletion when using avoid_flush_during_recovery e29d3b67c Make max_background_compactions and base_background_compactions dynamic changeable 21e8daced fix assertion failure in Prev() b9311aa65 Implement WinRandomRW file and improve code reuse (#1388) a249a0b75 check_format_compatible.sh to use some branch which allows to run with GCC 4.8 (#1393) 040328a30 Remove an assertion for single-delete in MergeHelper::MergeUntil 8cbe3e10c Relax the acceptable bias RateLimiterTest::Rate test be 25% f26a139d8 Log successful AddFile 5691a1d8a Fix compaction conflict with running compaction 017de666c fixup commit 1b7af5fb1 Redo handling of recycled logs in full purge 27bfe327b Editorial change to README.md 89cc404de A bit of doc restructuring 9e7fda829 Fix arcanist 2e4b5cab0 Add missing RateLimiter class to the Windows build (#1382) ce4963fdf [doc] Document that Visual Studio 2015+ is now required for Windows builds (#1389) e48927098 Fix scoped arena iterator (#1387) f8d8cf53f Fix log_write_bench -bytes_per_sync option. (#1375) 02b3e3985 Make txn->GetState() const 447f17127 new Prev() prefix support using SeekForPrev() 991b585ee More block cache tickers d6ae6dec6 Add Statistics::getAndResetTickerCount(). aea3ce4c8 Avoid string CONCAT which is not supported in cmake 2.6 (#1383) 2ad68b971 Support running consistency checks in release mode 67501cfc9 Fix -ve std::string::resize 04b02dd12 Testing asset links after config change 8c55bb87c Make Lock Info test multiple column families d06232897 Revert "Support SST files with Global sequence numbers" 5cd28833a [RocksJava] Adjusted RateLimiter to 3.10.0 (#1368) 37737c3a6 Expose Transaction State Publicly 2c1f95291 Add facility to write only a portion of WriteBatch to WAL 043cb62d6 Fix record_size in log_write_bench, swap args to std::string::assign. (#1373) 4985f60fc env_mirror: fix a few leaks (#1363) 5aded67dd update of c.h (#1371) 912aec13c "Recent Posts" -> "All Posts" 7cbb298db Make sure that when contribtuing we call out creating appropriate directories a06ad4711 Add top level doc information to CONTRIBUTING.md 3fdd5b971 A little more generic CONTRIBUTING.md ed4fc31db Add link to CONTRIBUTING.md to main docs README.md e4922e181 Forgot to truncate one blog post 6d8cd7ede Add CONTRIBUTING.md for rocksdb.org contribution guidance bd55e5a1e Fix some formatting of compaction blog post 0f60358b0 CRLF -> LF mod (including removing trailing whitespace for those files) b90e29c90 Truncate posts on the main /blog/ page 0d7acadaf Add author fields to blog posts 01be44181 Add GitHub link to the landing page header 9d6c96138 Fix Mac build ab01da543 Support SST files with Global sequence numbers d346ba246 Minor fixes around Windows 64 Java Artifacts (#1366) e91b4d0cf Add factory method for creating persistent cache that is accessible from public be1f1092c Expose transaction id, lock state information and transaction wait information 6009c473c Store range tombstones in memtable 3c21c64c7 Use size hint for HashMap in multiGet. Similar to https://github.com/facebook/rocksdb/pull/1344 (#1367) 13f7a01f6 Fixing JNI release build for gcc (#975) 7260662b3 Add Java API for SstFileWriter 26388247a delete unused variable for PrevInterval() 87dfc1d23 Fix conflict between AddFile() and CompactRange() eb44ed655 Update 2016-09-28-rocksdb-4-11-2-released.markdown e4437610d Update 2016-09-28-rocksdb-4-11-2-released.markdown 501f05108 Update 2016-09-28-rocksdb-4-11-2-released.markdown dec9009f8 Update 2016-09-28-rocksdb-4-11-2-released.markdown 4ed69dd0b Create 2016-09-28-rocksdb-4-11-2-released.markdown 21f4bb5a8 cmake support for linux and osx (#1358) 4defe306f fix typo in comments (#1360) f517d9dd0 Add SeekForPrev() to Iterator eb3894cf4 Recompute compaction score on SetOptions (#1346) 5c64fb67d Fix AddFile() conflict with compaction output [WaitForAddFile()] 9e9f5a0b9 Fix CompactFilesTest.ObsoleteFiles timeout (#1353) c2a62a4cb not cut compaction output when compact to level 0 9ed928e7a Split DBOptions into ImmutableDBOptions and MutableDBOptions 4bc8c88e6 Recover same sequence id from WAL (#1350) 0a1bd9c50 add cfh deletion started listener da5a9a65c Fix mac build d45eb6c6d Fix typo (#1349) abc0ae462 Add AddFile() InternalStats for Total files/L0 files/total keys ingested 715256338 forbid merge during recovery 5735b3dc2 Fix compiling under -Werror=missing-field-initializers 654ed9a28 loose the assertion condition of rate_limiter_test e4d3f5d9b Fix DBImpl::GetWalPreallocateBlockSize Mac build error 7afbb7420 solve the problem of table_factory_to_write_=nullptr (#1342) d78a4401b DBImpl::GetWalPreallocateBlockSize() should return size_t 42ac9c5f1 Retry getting arcanist token on failure b666f8544 Consider more factors when determining preallocation size of WAL files 4c3f4496b Add TableBuilderOptions::level and relevant changes (#1335) 3edb9461b Avoid hard-coded sleep in EnvPosixTestWithParam.TwoPools 0a88f38b7 Remove ColumnFamilyData::options() 41a9070f8 Fix java makefile dependencies 8d9bf5c49 Fix DBOptionsTest.GetLatestOptions 40cfa3e02 Fix DBWALTest.RecoveryWithLogDataForSomeCFs with mac 06b4785fe Fix recovery for WALs without data for all CFs d7242ff4d Fix GetSortedWalFiles when log recycling enabled 17f76fc56 DB::GetOptions() reflect dynamic changed options 215d12826 Fix typo (#903) a958c2643 Rename jvalue to jval in rocksjni 0a165bd7d Have Facebook link point to RocksDB on FB 3639f3288 Fix bug in UnScSigned-off-by: xh931076284 <931076284@qq.com> (#1336) 8e061f974 Refactor GetMutableOptionsFromStrings 81747f1be Refactor MutableCFOptions ba65c816b Support POSIX RandomRWFile 1d980a8e3 Create CNAME 2adab1dde Add API links to the header bar a182b2981 Preserve blog comments in markdown f54de9230 Adding Dgraph to list of Users (#1291) 9e4aa798c Summary: (#1313) a10e8a056 Fix C api memtable rep bugs. (#1328) eb1d4d53c Release RocksDB 4.12 22d88e24d Allow an offset as well as a length to be specified for byte[] operations in RocksJava JNI (#1264) b06b19136 add C api for set wal_recovery_mode (#1327) 1cca09129 Temporarily revert Prev() prefix support de28a2553 Update HISTORY.md for thread-local stats 0fcb6dbed Remove extraneous function prototypes from c.h (#1326) 52ee07b02 Move AddFile() tests to external_sst_file_test.cc 66a91e260 Add NoSpace subcode to IOError (#1320) 67036c040 Fix Flaky ColumnFamilyTest.FlushCloseWALFiles 0e2da497c fix typo in option.h's comment (#1321) 6d61358a0 Add real Google Analytics ID 2d9d36ea4 Have "Edit on GitHub" point to master instead of gh-pages 937751898 Update landing page content 1ec75ee76 Add redirects from old blog posts link to new format 607628d34 Support ZSTD with finalized format ce1be2ce3 Fix build error on Windows (AppVeyor) (#1315) f7669b40b Fix Windows Build 22696b088 Fix uninitlized CompactionJob::SubcompactionState::current_output_file_size c1865e0f7 Trigger more tests per diff a88677d2c Remove ImmutableCFOptions from public API 80c75593e Fix data race in AddFile() with multiple files + custom comparator bug 5051755e3 Fix db_bench memory use after free (detected by clang_analyze) 4fd08f4b8 Ensure Correct Behavior of StatsLevel kExceptDetailedTimers and kExceptTimeForMutex (#1308) e14fbaae2 Add FAQ based on the front page of the current rocksdb.org 3c2262400 Migrate the RocksDB Worpdress blog over to Jekyll ee0e2201e Transfer the current Getting Started contents to GitHub Pages 5a0e9a4cf Initial Landing Page 9447a8540 Remove the `doc` directory 32149059f Merge options source_compaction_factor, max_grandparent_overlap_bytes and expanded_compaction_factor into max_compaction_bytes 4590b53a4 add stats to Cache::LookUp() 85bb30825 Expose Utility function StringToMap() (#1306) 8ce1b8440 Fix Travis on Mac 380e651af Fix Mac build failure (#1309) 1613fa949 Thread-specific histogram statistics 6a14d55bd add prefix_seek_mode to db_iter_test de47e2bd4 Fix ClockCache memory leak f099af4c7 Fix travis db74b1a21 fix bug in merge_iterator when data race happens b18f9c9ea add nullptr check to internal_prefix_transform 4e395e875 Update docs README.md 2482d5fb4 support Prev() in prefix seek mode 7541c7a79 Fix cache_test valgrind_check failure c8513cde0 Update the download location of Snappy (#1304) b49b92cf2 Introduce Read amplification bitmap (read amp statistics) c7004840d store prefix_extractor_name in table 4ad928e17 add comment to SimCache to estimate actual capacity e9b2af87f Expose ThreadPool under include/rocksdb/threadpool.h 23a057007 Document memtable flush behavior in CancelAllBackgroundWork() dade61ac2 Mitigate regression bug of options.max_successive_merges hit during DB Recovery cce702a6e [db_bench] Support single benchmark arguments (Repeat for X times, Warm up for X times), Support CombinedStats (AVG / MEDIAN) 3586901f8 cat tests logs sorted by exit code b2ce59537 Persist data during user initiated shutdown 4b3438d2d Fix parallel valgrind (valgrind_check) a081f798b Relax consistency for thread-local ticker stats b10d65c2a Update and slightly clarify instructions in build_detect_platform (#1301) f85f99bf6 Fix the Windows build of RocksDB Java. Similar to https://github.com/facebook/rocksdb/issues/1220 (#1284) 7b8109517 Fix a crash when compaction fails to open a file 7c9586837 Thread-specific ticker statistics ea9e0757f Add initial GitHub pages infra for RocksDB documentation move and update. (#1294) 2a9c97108 [Flaky Test] Disable DBPropertiesTest.GetProperty d76ddf327 Disable ClockCache db_crashtest cec2c6436 fix data race in NewIndexIterator() in block_based_table_reader.cc badbff65b Not insert into block cache if cache is full and not holding handle 4a16c32ec Option to cache index/filter blocks with priority 99c4af716 Make ClockCache available with TSAN build f57bc1d03 Fix lambda expression for clang/windows 5440675c3 Fix lambda capture expression for windows 6584cec8f Fold function for thread-local data 817eeb29b Add singleDelete to RocksJava (#1275) ffdf6eee1 Add Status to RocksDBException so that meaningful function result Status from the C++ API isn't lost (#1273) ecf900386 Fix bug in printing values for block-based table 72f8cc703 LRU cache mid-point insertion 6a17b07ca Add TablePropertiesCollector support in SstFileWriter 78837f5d6 TableBuilder / TableReader support for range deletion 4cc37f59e Introduce ClockCache ff17a2abf Adding TBB as dependency. 49d88be02 c abi: allow compaction filter ignore snapshot (#1268) 0b63f51fb fixes 1215: execute_process(COMMAND mkdir ${DIR}) fails to create a directory with cmake on Windows (#1219) 3981345be Small nits (#1280) 2a2ebb6f5 Move LRUCache structs to lru_cache.h header 2fc2fd92a Single Delete Mismatch and Fallthrough statistics 3771e3797 WriteBatch support for range deletion 236756f2c Make SyncPoint return immediately when disabled 64a0082c6 Fix DBSSTest::AddExternalSstFileSkipSnapshot valgrind fail dd7a748cf Fix java build 4fe12baa6 Make db_bench less space for --stats_per_interval 6525ce4ca Compaction stats printing: "batch" => "commit group" a117891b4 Fixed typo (#1279) b248e98cf Fix a destruction order issue in ThreadStatusUpdater deda159b5 Added min/max/avg data block size output to sst_dump e408e98c8 add Name() to Cache a297643f2 Fix valgrind memory leak d11c09d9e Eliminate memcpy from ForwardIterator d36755502 Added further Java API options for controlling concurrent writes ebdfe34cc Exposed further Java API options for controlling compaction d1be59463 Improve documentation of SliceTransform. 6056d6317 Improve comment and bug fix for GetOptionsFromMap functions in convenience.h 76a67cf74 support stackableDB as the baseDB of transactionDB 67c1ae883 Travis build break fix b693ba68b Minor PinnedIteratorsManager Refactoring db3dfb164 Fixes for arcanist config (#1271) 87c91bd87 Persistent Read Cache (8) Benchmark tooling 2914de64e add sim_cache stats to Statistics 8b79422b5 [Proof-Of-Concept] RocksDB Blob Storage with a blob log file. 4beffe001 Fix test data race in two FaultInjectionTest tests 821bcb0b3 util/arena.cc: FreeBSD: More portable use of mmap(MAP_ANON) (#1254) 5370f44a8 Increase RocksDB version 56dd03411 read_options.background_purge_on_iterator_cleanup to cover forward iterator and log file closing too. ccecf3f4f UniversalCompaction should ignore sorted runs being compacted (when compacting for file num) 1b0069ce2 Remove non-gtest from parallelized tests 638c49f24 Change HISTORY.md for release 4.11 6b8e9c68b fix vs generator (#1269) c38b075e7 Update HISTORY.md 8f399e3fe Update HISTORY.md 98d0b78ea Added check_snapshot option in the DB's AddFile function (#1261) 9fd68b7fb set travis open file descriptor limit 59ddb5059 Fix travis build break f4d986364 Added SetOptions support to RocksJava (#1243) 7882cb977 Make DBOptionsTest::EnableAutoCompactionAndTriggerStall less falky 44f5cc57a Add time series database (resubmitted) 7c4615cf1 A utility function to help users migrate DB after options change 5bb0a7f73 Update appveyor.…
- Loading branch information