leveldb Team
d152b23f3b
Defend against inclusion of windows.h in tests that invoke
Env::DeleteFile.
PiperOrigin-RevId: 283607548
5 years ago
Victor Costan
58a89bbcb2
Add WITHOUT ROWID to SQLite benchmark.
The SQLite-specific schema feature is documented at
https://www.sqlite.org/withoutrowid.html and
https://www.sqlite.org/rowidtable.html .
By default, SQLite stores each table in a B-tree keyed by an integer,
called the ROWID. Any index, including the PRIMARY KEY index, is a
separate B-tree mapping index keys to ROWIDs. Tables without ROWIDs are
stored in a B-tree keyed by the primary key. Additional indexes (the
PRIMARY KEY index is implicitly built into the table) are stored as
B-trees mapping index keys to row primary keys.
This CL introduces a boolean --use-rowids flag to db_bench_sqlite. When
the flag is false (default), the schema of the test table includes
WITHOUT ROWID. The test table uses a primary key, so adding WITHOUT
ROWID to the schema reduces the number of B-trees used by the benchmark
from 2 to 1. This brings SQLite's disk usage closer to LevelDB.
When WITHOUT ROWID is used, SQLite fares better (than today) on
benchmarks with small (16-byte) keys, and worse on benchmarks with large
(100kb) keys.
Baseline results:
fillseq : 21.310 micros/op; 5.2 MB/s
fillseqsync : 146.377 micros/op; 0.8 MB/s (10000 ops)
fillseqbatch : 2.065 micros/op; 53.6 MB/s
fillrandom : 34.767 micros/op; 3.2 MB/s
fillrandsync : 159.943 micros/op; 0.7 MB/s (10000 ops)
fillrandbatch : 15.055 micros/op; 7.3 MB/s
overwrite : 43.660 micros/op; 2.5 MB/s
overwritebatch : 27.691 micros/op; 4.0 MB/s
readrandom : 12.725 micros/op;
readseq : 2.602 micros/op; 36.7 MB/s
fillrand100K : 606.333 micros/op; 157.3 MB/s (1000 ops)
fillseq100K : 657.457 micros/op; 145.1 MB/s (1000 ops)
readseq : 46.523 micros/op; 2049.9 MB/s
readrand100K : 54.943 micros/op;
Results after this CL:
fillseq : 16.231 micros/op; 6.8 MB/s
fillseqsync : 147.460 micros/op; 0.8 MB/s (10000 ops)
fillseqbatch : 2.294 micros/op; 48.2 MB/s
fillrandom : 27.871 micros/op; 4.0 MB/s
fillrandsync : 141.979 micros/op; 0.8 MB/s (10000 ops)
fillrandbatch : 16.087 micros/op; 6.9 MB/s
overwrite : 26.829 micros/op; 4.1 MB/s
overwritebatch : 19.014 micros/op; 5.8 MB/s
readrandom : 11.657 micros/op;
readseq : 0.155 micros/op; 615.0 MB/s
fillrand100K : 816.812 micros/op; 116.8 MB/s (1000 ops)
fillseq100K : 754.689 micros/op; 126.4 MB/s (1000 ops)
readseq : 47.112 micros/op; 2024.3 MB/s
readrand100K : 287.679 micros/op;
Results after this CL, with --use-rowids=1
fillseq : 20.655 micros/op; 5.4 MB/s
fillseqsync : 146.408 micros/op; 0.8 MB/s (10000 ops)
fillseqbatch : 2.045 micros/op; 54.1 MB/s
fillrandom : 34.080 micros/op; 3.2 MB/s
fillrandsync : 154.582 micros/op; 0.7 MB/s (10000 ops)
fillrandbatch : 14.404 micros/op; 7.7 MB/s
overwrite : 42.928 micros/op; 2.6 MB/s
overwritebatch : 27.829 micros/op; 4.0 MB/s
readrandom : 12.835 micros/op;
readseq : 2.483 micros/op; 38.4 MB/s
fillrand100K : 603.265 micros/op; 158.1 MB/s (1000 ops)
fillseq100K : 662.473 micros/op; 144.0 MB/s (1000 ops)
readseq : 45.478 micros/op; 2097.0 MB/s
readrand100K : 54.439 micros/op;
PiperOrigin-RevId: 283407101
5 years ago
Victor Costan
c0d43142ff
Merge pull request #756 from pwnall/third_party_2
Fixup for adding the third_party/googletest submodule.
5 years ago
Victor Costan
e36b831851
Fixup for adding the third_party/googletest submodule.
5 years ago
leveldb Team
583a42b596
Internal change.
PiperOrigin-RevId: 282373286
5 years ago
Victor Costan
db8352187b
Fixup for adding the third_party/googletest submodule. ( #754 )
5 years ago
Victor Costan
1c58902bdc
Switch testing harness to googletest.
PiperOrigin-RevId: 281815695
5 years ago
Victor Costan
2c9c80bd53
Move CI to Visual Studio 2019.
PiperOrigin-RevId: 279785825
5 years ago
Victor Costan
ed72a3496e
Allow different C/C++ standards when this is used as a subproject.
Inspired by https://github.com/google/snappy/pull/85
PiperOrigin-RevId: 279649967
5 years ago
Victor Costan
41c8d83914
Align CMake configuration with related projects.
PiperOrigin-RevId: 279238007
5 years ago
Victor Costan
0c40829872
Remove redundant PROJECT_SOURCE_DIR usage from CMake config.
Inspired by https://github.com/google/crc32c/pull/32
PiperOrigin-RevId: 278718726
5 years ago
Victor Costan
5abdf4c019
Fix installed target definition.
Using CMAKE_INSTALL_INCLUDEDIR before including GNUINstallDirs results
in a broken installation when CMAKE_INSTALL_PREFIX is a non-standard
directory.
Inspired from https://github.com/google/crc32c/pull/39
PiperOrigin-RevId: 278427974
5 years ago
Victor Costan
cf4d9ab23d
Test CMake installation on Travis.
PiperOrigin-RevId: 278300591
5 years ago
Chris Mumford
95d0ba1cb0
Renamed local variable in DBImpl::Write.
The local variable `updates` in DBImpl::Write was hiding the
`updates` parameter. Renamed to avoid this conflict.
PiperOrigin-RevId: 277089971
5 years ago
Chris Mumford
657ba51429
Added return in Version::Get::State::Match to quiet warning.
Added unreached return at the end of Version::Get::State::Match
to stop this _incorrect_ warning:
version_set.cc:376:5: warning: control reaches end of
non-void function [-Wreturn-type]
This warning was being emitted when building with clang 6.0.1-10
and also emitted by lgtm.com when statically analyzing leveldb even
though all SaverState enumeration values were handled.
PiperOrigin-RevId: 272455474
5 years ago
Liao Tonglang
f2dae4e74a
fix typo in comment of LRUHandle
LRUHandle has no member "next_", fix it to "next" instead.
5 years ago
Henry Lee
f933ad1693
Remove unused variable kDelayMicros in env_test.cc
5 years ago
Chris Mumford
370d532a00
Using CMake's check_cxx_compiler_flag to check support for -Wthread-safety.
Previously used check_cxx_source_compiles to attempt a
build to determine support for clang thread safety checks.
This change is to support static analysis of the leveldb source by
lgtm.com (using Semmle). It failed to build with the following error:
```
[2019-07-04 22:29:58] [build] c++: error: unrecognized command line option ‘-Wthread-safety’; did you mean ‘-fthread-jumps’?
[2019-07-04 22:30:02] [build] make[2]: *** [CMakeFiles/leveldb.dir/build.make:66: CMakeFiles/leveldb.dir/db/builder.cc.o] Error 1
```
PiperOrigin-RevId: 272275528
5 years ago
Victor Costan
45ee61579c
Update Travis CI configuration.
* Use Ubuntu 18.04 and LLVM 9 on Travis.
* Fix bash conditionals: [ a == b ] should be [ a = b ].
PiperOrigin-RevId: 271898719
5 years ago
Sanjay Ghemawat
60db170a43
Fix tsan problem in env_test.
PiperOrigin-RevId: 268265314
5 years ago
Victor Costan
21304d41f7
Merge pull request #698 from neal-zhu:master
PiperOrigin-RevId: 266001777
5 years ago
neal-zhu
5e921896ee
drop fileds in State that are duplicates of fileds in Saver and fix typo
5 years ago
Chris Mumford
53e280b568
Simplify unlocking in DeleteObsoleteFiles.
A recent change (4cb80b7ddc
) to DBImpl::DeleteObsoleteFiles
unlocked DBImpl::mutex_ while deleting files to allow for
greater concurrency. This change improves on the prior in
a few areas:
1. The table is evicted from the table cache before unlocking
the mutex. This should only improve performance.
2. This implementation is slightly simpler, but at the cost of
a bit more memory usage.
3. A comment adding more detail as to why the mutex is being
unlocked and why it is safe to do so.
PiperOrigin-RevId: 253111645
5 years ago
Chris Mumford
046216a7ca
Add "leveldb" subdirectory to public include paths.
The documentation (README.md and index.md) referred to the
public headers using an incorrect path - fixing.
PiperOrigin-RevId: 252922925
5 years ago
Chris Mumford
9ee91ac747
Ending sentences with periods in README.md.
This change was submitted in https://github.com/google/leveldb/pull/575
by @prajwalchalla .
This fixes issue #523 .
PiperOrigin-RevId: 252912613
5 years ago
Victor Costan
e0d5f83a4f
Align EnvPosix and EnvWindows.
Fixes #695 .
PiperOrigin-RevId: 252895299
5 years ago
Victor Costan
69061b464a
Disable exceptions and RTTI in CMake configuration.
PiperOrigin-RevId: 252842234
5 years ago
neal-zhu
107a75b62c
cache Saver in State object
5 years ago
neal-zhu
76ca116276
fix bug(uninitialized options pointer in State)
5 years ago
neal-zhu
f668239bb2
remove TODO in Version::ForEachOverlapping
5 years ago
neal-zhu
177cd08629
format
5 years ago
neal-zhu
8fa7a937ee
fix bug
5 years ago
neal-zhu
6a90bb91ee
use ForEachOverlapping to impl Get
5 years ago
Chris Mumford
4cb80b7ddc
Merge pull request #386 from ivanabc:master
PiperOrigin-RevId: 250702492
5 years ago
Victor Costan
72a38ff7f2
Replace "> >" with ">>"
PiperOrigin-RevId: 250383036
5 years ago
Victor Costan
863f185970
unsigned char -> uint8_t
PiperOrigin-RevId: 250309603
5 years ago
Victor Costan
a3b71c1ff6
Use GCC 9 on Travis CI
PiperOrigin-RevId: 249899128
5 years ago
Chris Mumford
ae49533210
Add explicit typecasts to avoid compiler warning.
Fixes issue #684 .
PiperOrigin-RevId: 249531001
5 years ago
ivan
63d5315e1c
Merge branch 'master' into master
5 years ago
Chris Mumford
c00e177f36
Guard DBImpl::versions_ by mutex_.
mutex_ was already acquired before accessing DBImpl::versions_ in all
but one place: DBImpl::GetApproximateSizes. This change requires mutex_
to be held before accessing versions_.
PiperOrigin-RevId: 248390814
5 years ago
Chris Mumford
1d0b101165
Converted two for-loops to while-loops.
Converted `for (;<condition>;)` to `while (<condition>)`.
PiperOrigin-RevId: 247950510
5 years ago
Chris Mumford
28e6d238be
Switch to using C++ 11 override specifier.
PiperOrigin-RevId: 247491163
5 years ago
Chris Mumford
85cd40d108
Added unit test for InternalKey::DecodeFrom with empty string.
PiperOrigin-RevId: 247483339
5 years ago
Chris Mumford
1aae5c9f29
Merge pull request #411 from proller:assert1
PiperOrigin-RevId: 247424040
5 years ago
Chris Mumford
b7b86baec9
Using std::ostringstream in key DebugString.
Switching from snprintf to std::ostringstream eliminates
cast warning for (unsigned long long).
PiperOrigin-RevId: 247326681
5 years ago
Chris Mumford
3e6c000e18
Merge pull request #457 from jellor:patch-2
PiperOrigin-RevId: 247261470
5 years ago
果冻
1d94fe2f4d
Merge branch 'master' into patch-2
5 years ago
Victor Costan
27dc99fb26
Fix EnvPosix tests on Travis CI.
The previous attempt of having EnvPosix use O_CLOEXEC (close-on-exec()) when opening file descriptors added tests that relied on procfs, which is Linux-specific. These tests failed on macOS. Unfortunately, the test failures were not caught due to a (since fixed) error in our Travis CI configuration.
This CL re-structures the tests to only rely on POSIX features. Since there is no POSIX-compliant way to get a file name/path out of a file descriptor, this CL breaks up the O_CLOEXEC test into multiple tests, where each Env method that creates an FD gets its own test. This is intended to make it easier to find and fix errors in Env implementations.
This CL also fixes the implementation of NewLogger() to use O_CLOEXEC on macOS. The current implementation passes "we" to fopen(), but the macOS standard C library does not implement the "e" flag yet.
PiperOrigin-RevId: 247088953
5 years ago
Chris Mumford
9521545b06
Formatting changes for prior O_CLOEXEC fix.
Two minor corrections to correct the 900f7d37eb
commit
to conform to the Google C++ style guide.
PiperOrigin-RevId: 246907647
5 years ago
Chris Mumford
900f7d37eb
Merge pull request #624 from adam-azarchs:master
PiperOrigin-RevId: 246903086
5 years ago