Skip to content
This repository has been archived by the owner on Feb 26, 2020. It is now read-only.

Commit

Permalink
Squashed 'rocksdb-sys/rocksdb/' changes from 9808491..fea6fdd
Browse files Browse the repository at this point in the history
fea6fdd Fix @see in two Java functions (#1396)
b1031d6 Remove function local statics that interfere with memory pooling (#1392)
f470540 Handle WAL deletion when using avoid_flush_during_recovery
e29d3b6 Make max_background_compactions and base_background_compactions dynamic changeable
21e8dac fix assertion failure in Prev()
b9311aa Implement WinRandomRW file and improve code reuse (#1388)
a249a0b check_format_compatible.sh to use some branch which allows to run with GCC 4.8 (#1393)
040328a Remove an assertion for single-delete in MergeHelper::MergeUntil
8cbe3e1 Relax the acceptable bias RateLimiterTest::Rate test be 25%
f26a139 Log successful AddFile
5691a1d Fix compaction conflict with running compaction
017de66 fixup commit
1b7af5f Redo handling of recycled logs in full purge
27bfe32 Editorial change to README.md
89cc404 A bit of doc restructuring
9e7fda8 Fix arcanist
2e4b5ca Add missing RateLimiter class to the Windows build (#1382)
ce4963f [doc] Document that Visual Studio 2015+ is now required for Windows builds (#1389)
e489270 Fix scoped arena iterator (#1387)
f8d8cf5 Fix log_write_bench -bytes_per_sync option. (#1375)
02b3e39 Make txn->GetState() const
447f171 new Prev() prefix support using SeekForPrev()
991b585 More block cache tickers
d6ae6de Add Statistics::getAndResetTickerCount().
aea3ce4 Avoid string CONCAT which is not supported in cmake 2.6 (#1383)
2ad68b9 Support running consistency checks in release mode
67501cf Fix -ve std::string::resize
04b02dd Testing asset links after config change
8c55bb8 Make Lock Info test multiple column families
d062328 Revert "Support SST files with Global sequence numbers"
5cd2883 [RocksJava] Adjusted RateLimiter to 3.10.0 (#1368)
37737c3 Expose Transaction State Publicly
2c1f952 Add facility to write only a portion of WriteBatch to WAL
043cb62 Fix record_size in log_write_bench, swap args to std::string::assign. (#1373)
4985f60 env_mirror: fix a few leaks (#1363)
5aded67 update of c.h (#1371)
912aec1 "Recent Posts" -> "All Posts"
7cbb298 Make sure that when contribtuing we call out creating appropriate directories
a06ad47 Add top level doc information to CONTRIBUTING.md
3fdd5b9 A little more generic CONTRIBUTING.md
ed4fc31 Add link to CONTRIBUTING.md to main docs README.md
e4922e1 Forgot to truncate one blog post
6d8cd7e Add CONTRIBUTING.md for rocksdb.org contribution guidance
bd55e5a Fix some formatting of compaction blog post
0f60358 CRLF -> LF mod (including removing trailing whitespace for those files)
b90e29c Truncate posts on the main /blog/ page
0d7acad Add author fields to blog posts
01be441 Add GitHub link to the landing page header
9d6c961 Fix Mac build
ab01da5 Support SST files with Global sequence numbers
d346ba2 Minor fixes around Windows 64 Java Artifacts (#1366)
e91b4d0 Add factory method for creating persistent cache that is accessible from public
be1f109 Expose transaction id, lock state information and transaction wait information
6009c47 Store range tombstones in memtable
3c21c64 Use size hint for HashMap in multiGet. Similar to facebook/rocksdb#1344 (#1367)
13f7a01 Fixing JNI release build for gcc (rust-rocksdb#975)
7260662 Add Java API for SstFileWriter
2638824 delete unused variable for PrevInterval()
87dfc1d Fix conflict between AddFile() and CompactRange()
eb44ed6 Update 2016-09-28-rocksdb-4-11-2-released.markdown
e443761 Update 2016-09-28-rocksdb-4-11-2-released.markdown
501f051 Update 2016-09-28-rocksdb-4-11-2-released.markdown
dec9009 Update 2016-09-28-rocksdb-4-11-2-released.markdown
4ed69dd Create 2016-09-28-rocksdb-4-11-2-released.markdown
21f4bb5 cmake support for linux and osx (#1358)
4defe30 fix typo in comments (#1360)
f517d9d Add SeekForPrev() to Iterator
eb3894c Recompute compaction score on SetOptions (#1346)
5c64fb6 Fix AddFile() conflict with compaction output [WaitForAddFile()]
9e9f5a0 Fix CompactFilesTest.ObsoleteFiles timeout (#1353)
c2a62a4 not cut compaction output when compact to level 0
9ed928e Split DBOptions into ImmutableDBOptions and MutableDBOptions
4bc8c88 Recover same sequence id from WAL (#1350)
0a1bd9c add cfh deletion started listener
da5a9a6 Fix mac build
d45eb6c Fix typo (#1349)
abc0ae4 Add AddFile() InternalStats for Total files/L0 files/total keys ingested
7152563 forbid merge during recovery
5735b3d Fix compiling under -Werror=missing-field-initializers
654ed9a loose the assertion condition of rate_limiter_test
e4d3f5d Fix DBImpl::GetWalPreallocateBlockSize Mac build error
7afbb74 solve the problem of table_factory_to_write_=nullptr (#1342)
d78a440 DBImpl::GetWalPreallocateBlockSize() should return size_t
42ac9c5 Retry getting arcanist token on failure
b666f85 Consider more factors when determining preallocation size of WAL files
4c3f449 Add TableBuilderOptions::level and relevant changes (#1335)
3edb946 Avoid hard-coded sleep in EnvPosixTestWithParam.TwoPools
0a88f38 Remove ColumnFamilyData::options()
41a9070 Fix java makefile dependencies
8d9bf5c Fix DBOptionsTest.GetLatestOptions
40cfa3e Fix DBWALTest.RecoveryWithLogDataForSomeCFs with mac
06b4785 Fix recovery for WALs without data for all CFs
d7242ff Fix GetSortedWalFiles when log recycling enabled
17f76fc DB::GetOptions() reflect dynamic changed options
215d128 Fix typo (rust-rocksdb#903)
a958c26 Rename jvalue to jval in rocksjni
0a165bd Have Facebook link point to RocksDB on FB
3639f32 Fix bug in UnScSigned-off-by: xh931076284 <931076284@qq.com> (#1336)
8e061f9 Refactor GetMutableOptionsFromStrings
81747f1 Refactor MutableCFOptions
ba65c81 Support POSIX RandomRWFile
1d980a8 Create CNAME
2adab1d Add API links to the header bar
a182b29 Preserve blog comments in markdown
f54de92 Adding Dgraph to list of Users (#1291)
9e4aa79 Summary: (#1313)
a10e8a0 Fix C api memtable rep bugs. (#1328)
eb1d4d5 Release RocksDB 4.12
22d88e2 Allow an offset as well as a length to be specified for byte[] operations in RocksJava JNI (#1264)
b06b191 add C api for set wal_recovery_mode (#1327)
1cca091 Temporarily revert Prev() prefix support
de28a25 Update HISTORY.md for thread-local stats
0fcb6db Remove extraneous function prototypes from c.h (#1326)
52ee07b Move AddFile() tests to external_sst_file_test.cc
66a91e2 Add NoSpace subcode to IOError (#1320)
67036c0 Fix Flaky ColumnFamilyTest.FlushCloseWALFiles
0e2da49 fix typo in option.h's comment (#1321)
6d61358 Add real Google Analytics ID
2d9d36e Have "Edit on GitHub" point to master instead of gh-pages
9377518 Update landing page content
1ec75ee Add redirects from old blog posts link to new format
607628d Support ZSTD with finalized format
ce1be2c Fix build error on Windows (AppVeyor) (#1315)
f7669b4 Fix Windows Build
22696b0 Fix uninitlized CompactionJob::SubcompactionState::current_output_file_size
c1865e0 Trigger more tests per diff
a88677d Remove ImmutableCFOptions from public API
80c7559 Fix data race in AddFile() with multiple files + custom comparator bug
5051755 Fix db_bench memory use after free (detected by clang_analyze)
4fd08f4 Ensure Correct Behavior of StatsLevel kExceptDetailedTimers and kExceptTimeForMutex  (#1308)
e14fbaa Add FAQ based on the front page of the current rocksdb.org
3c22624 Migrate the RocksDB Worpdress blog over to Jekyll
ee0e220 Transfer the current Getting Started contents to GitHub Pages
5a0e9a4 Initial Landing Page
9447a85 Remove the `doc` directory
3214905 Merge options source_compaction_factor, max_grandparent_overlap_bytes and expanded_compaction_factor into max_compaction_bytes
4590b53 add stats to Cache::LookUp()
85bb308 Expose Utility function StringToMap() (#1306)
8ce1b84 Fix Travis on Mac
380e651 Fix Mac build failure (#1309)
1613fa9 Thread-specific histogram statistics
6a14d55 add prefix_seek_mode to db_iter_test
de47e2b Fix ClockCache memory leak
f099af4 Fix travis
db74b1a fix bug in merge_iterator when data race happens
b18f9c9 add nullptr check to internal_prefix_transform
4e395e8 Update docs README.md
2482d5f support Prev() in prefix seek mode
7541c7a Fix cache_test valgrind_check failure
c8513cd Update the download location of Snappy (#1304)
b49b92c Introduce Read amplification bitmap (read amp statistics)
c700484 store prefix_extractor_name in table
4ad928e add comment to SimCache to estimate actual capacity
e9b2af8 Expose ThreadPool under include/rocksdb/threadpool.h
23a0570 Document memtable flush behavior in CancelAllBackgroundWork()
dade61a Mitigate regression bug of options.max_successive_merges hit during DB Recovery
cce702a [db_bench] Support single benchmark arguments (Repeat for X times, Warm up for X times), Support CombinedStats (AVG / MEDIAN)
3586901 cat tests logs sorted by exit code
b2ce595 Persist data during user initiated shutdown
4b3438d Fix parallel valgrind (valgrind_check)
a081f79 Relax consistency for thread-local ticker stats
b10d65c Update and slightly clarify instructions in build_detect_platform (#1301)
f85f99b Fix the Windows build of RocksDB Java. Similar to facebook/rocksdb#1220 (#1284)
7b81095 Fix a crash when compaction fails to open a file
7c95868 Thread-specific ticker statistics
ea9e075 Add initial GitHub pages infra for RocksDB documentation move and update. (#1294)
2a9c971 [Flaky Test] Disable DBPropertiesTest.GetProperty
d76ddf3 Disable ClockCache db_crashtest
cec2c64 fix data race in NewIndexIterator() in block_based_table_reader.cc
badbff6 Not insert into block cache if cache is full and not holding handle
4a16c32 Option to cache index/filter blocks with priority
99c4af7 Make ClockCache available with TSAN build
f57bc1d Fix lambda expression for clang/windows
5440675 Fix lambda capture expression for windows
6584cec Fold function for thread-local data
817eeb2 Add singleDelete to RocksJava (#1275)
ffdf6ee Add Status to RocksDBException so that meaningful function result Status from the C++ API isn't lost (#1273)
ecf9003 Fix bug in printing values for block-based table
72f8cc7 LRU cache mid-point insertion
6a17b07 Add TablePropertiesCollector support in SstFileWriter
78837f5 TableBuilder / TableReader support for range deletion
4cc37f5 Introduce ClockCache
ff17a2a Adding TBB as dependency.
49d88be c abi: allow compaction filter ignore snapshot (#1268)
0b63f51 fixes 1215: execute_process(COMMAND mkdir ${DIR}) fails to create a directory with cmake on Windows (#1219)
3981345 Small nits (#1280)
2a2ebb6 Move LRUCache structs to lru_cache.h header
2fc2fd9 Single Delete Mismatch and Fallthrough statistics
3771e37 WriteBatch support for range deletion
236756f Make SyncPoint return immediately when disabled
64a0082 Fix DBSSTest::AddExternalSstFileSkipSnapshot valgrind fail
dd7a748 Fix java build
4fe12ba Make db_bench less space for --stats_per_interval
6525ce4 Compaction stats printing: "batch" => "commit group"
a117891 Fixed typo (#1279)
b248e98 Fix a destruction order issue in ThreadStatusUpdater
deda159 Added min/max/avg data block size output to sst_dump
e408e98 add Name() to Cache
a297643 Fix valgrind memory leak
d11c09d Eliminate memcpy from ForwardIterator
d367555 Added further Java API options for controlling concurrent writes
ebdfe34 Exposed further Java API options for controlling compaction
d1be594 Improve documentation of SliceTransform.
6056d63 Improve comment and bug fix for GetOptionsFromMap functions in convenience.h
76a67cf support stackableDB as the baseDB of transactionDB
67c1ae8 Travis build break fix
b693ba6 Minor PinnedIteratorsManager Refactoring
db3dfb1 Fixes for arcanist config (#1271)
87c91bd Persistent Read Cache (8) Benchmark tooling
2914de6 add sim_cache stats to Statistics
8b79422 [Proof-Of-Concept] RocksDB Blob Storage with a blob log file.
4beffe0 Fix test data race in two FaultInjectionTest tests
821bcb0 util/arena.cc: FreeBSD: More portable use of mmap(MAP_ANON) (#1254)
5370f44 Increase RocksDB version
56dd034 read_options.background_purge_on_iterator_cleanup to cover forward iterator and log file closing too.
ccecf3f UniversalCompaction should ignore sorted runs being compacted (when compacting for file num)
1b0069c Remove non-gtest from parallelized tests
638c49f Change HISTORY.md for release 4.11
6b8e9c6 fix vs generator (#1269)
c38b075 Update HISTORY.md
8f399e3 Update HISTORY.md
98d0b78 Added check_snapshot option in the DB's AddFile function (#1261)
9fd68b7 set travis open file descriptor limit
59ddb50 Fix travis build break
f4d9863 Added SetOptions support to RocksJava (#1243)
7882cb9 Make DBOptionsTest::EnableAutoCompactionAndTriggerStall less falky
44f5cc5 Add time series database (resubmitted)
7c4615c A utility function to help users migrate DB after options change
5bb0a7f Update appveyor.yml
86396cc Update appveyor.yml
c1db098 Update appveyor.yml
7da2eaf Update appveyor.yml
34723b4 Cleanup unused variable pending_fsync_.
7cc0dbd cat all logs in sandcastle output
9253767 Correct geHistogramData() -> getHistogramData() (#1257)
f35b16f db_bench add an option of --base_background_compactions
c3a4bea Fix flaky test `ObsoleteFiles`
8234faa Fix failed test
4990c0d Remove deprecated LEVELDB_PLATFORM_POSIX
7323e4c Fix clang on macOS
ee027fc Ignore write stall triggers when auto-compaction is disabled
e4609a7 Fix Windows build issues (#1253)
2306167 Fix clang build failure and refactor unit test
343304e Use StopWatch to do statistic job in db_impl_add_file.cc
cdc4eb6 Add a GetComparator() function to the ColumnFamilyHandle base class so that the user's comparator can be retrieved.
712dd27 Build break fixes
0155c73 Fix parallel tests `make check -j`
c49ea68 Fix to enable running CI jobs locally
726c2f7 Build break fix
d51dc96 Experiments on column-aware encodings
c116b47 Persistent Read Cache (part 6) Block Cache Tier Implementation
64046e5 Write a benchmark to emulate time series data
REVERT: 9808491 Release 4.11.2
REVERT: fbd1c98 Fix recovery for WALs without data for all CFs
REVERT: c743289 Fix GetSortedWalFiles when log recycling enabled
REVERT: 2be165b Fix a crash when compaction fails to open a file
REVERT: 0f4c98d Increase version to 4.11.1
REVERT: c75f4fa fix data race in NewIndexIterator() in block_based_table_reader.cc
REVERT: 56f497b Mitigate regression bug of options.max_successive_merges hit during DB Recovery
REVERT: 051c88d Compaction stats printing: "batch" => "commit group"
REVERT: 071893e Fix a destruction order issue in ThreadStatusUpdater
REVERT: 7d7234a Change HISTORY.md for release 4.11
REVERT: d641bb8 read_options.background_purge_on_iterator_cleanup to cover forward iterator and log file closing too.
REVERT: e98b76d A utility function to help users migrate DB after options change
REVERT: 4001e79 Ignore write stall triggers when auto-compaction is disabled

git-subtree-dir: rocksdb-sys/rocksdb
git-subtree-split: fea6fdd6764a06a873cd0d6a632cf27ca8820100
  • Loading branch information
arkpar committed Oct 17, 2016
1 parent fa390de commit 019d3f1
Show file tree
Hide file tree
Showing 481 changed files with 30,271 additions and 6,854 deletions.
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,7 @@ build/
ldb
manifest_dump
sst_dump
column_aware_encoding_exp
util/build_version.cc
build_tools/VALGRIND_LOGS/
coverage/COVERAGE_REPORT
Expand Down
12 changes: 3 additions & 9 deletions .travis.yml
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ compiler:
addons:
apt:
sources: ['ubuntu-toolchain-r-test', 'llvm-toolchain-precise-3.6']
packages: ['clang-3.6' , 'zlib1g-dev', 'libbz2-dev', 'libsnappy-dev', 'curl']
packages: ['clang-3.6' , 'zlib1g-dev', 'libbz2-dev', 'libsnappy-dev', 'curl', 'gflags']
env:
# Run all tests before db_block_cache_test (db_test, db_test2)
- JOB_NAME=unittests ROCKSDBTESTS_END=db_block_cache_test
Expand All @@ -26,15 +26,9 @@ install:
- pushd /tmp/ && curl -L https://github.com/gflags/gflags/archive/v2.1.2.tar.gz -o gflags.tar.gz && tar xfz gflags.tar.gz && cd gflags-2.1.2 && cmake . && make && popd

before_script:
# Add gflags to include/library paths
# TODO(noetzli): Remove when gflags available through Travis
- export LD_LIBRARY_PATH="$LD_LIBRARY_PATH:/tmp/gflags-2.1.2/lib"
- export LIBRARY_PATH="$LIBRARY_PATH:/tmp/gflags-2.1.2/lib"
- export CPLUS_INCLUDE_PATH="$CPLUS_INCLUDE_PATH:/tmp/gflags-2.1.2/include"
- if [[ "${TRAVIS_OS_NAME}" == 'linux' ]]; then CXX=clang++-3.6; fi
- if [[ "${TRAVIS_OS_NAME}" == 'osx' ]]; then brew install gflags snappy; fi
# Limit the maximum number of open file descriptors to 2000
- ulimit -n 2000 || true
# Limit the maximum number of open file descriptors to 8192
- ulimit -n 8192 || true

script:
- if [[ "${JOB_NAME}" == 'unittests' ]]; then OPT=-DTRAVIS V=1 make -j4 check_some; fi
Expand Down
Loading

0 comments on commit 019d3f1

Please sign in to comment.