ArcueidType
c295a4a490
Complete Report in README
3 maanden geleden
ArcueidType
ff59f3e731
update README file
3 maanden geleden
李畅
47343f975b
report update again
3 maanden geleden
李畅
e5aaef2f4c
modify test
3 maanden geleden
李畅
07f2b8206f
add report
3 maanden geleden
李畅
f0a085c9a2
Merge branch 'main' of https://gitea.shuishan.net.cn/10225101440/leveldb_ttl into optimize
3 maanden geleden
李畅
d6199efe75
modify new test
3 maanden geleden
ArcueidType
308af20f79
update TEST LastLevelCompaction
3 maanden geleden
李畅
7ce859c2ce
Merge branch 'main' of https://gitea.shuishan.net.cn/10225101440/leveldb_ttl into optimize
3 maanden geleden
ArcueidType
47e4063400
simplify SetOtherInputs
3 maanden geleden
李畅
8562e5a189
Merge branch 'optimize' of https://gitea.shuishan.net.cn/10225101440/leveldb_ttl into optimize
3 maanden geleden
李畅
4ada9d0897
modify modeldb
3 maanden geleden
ArcueidType
45c1b090ae
newest implementation
3 maanden geleden
ArcueidType
de6432f1e2
optimize last level handling
3 maanden geleden
李畅
9676d35ddc
Merge branch 'light_ver' of https://gitea.shuishan.net.cn/10225101440/leveldb_ttl into light_ver
3 maanden geleden
李畅
5de63e747e
report ver1
3 maanden geleden
ArcueidType
c175e4ed40
comment for TEST LastLevelCompaction
3 maanden geleden
ArcueidType
2481ca24ba
config kNumLevels for TEST LastLevelCompaction
3 maanden geleden
ArcueidType
830f61ddb7
config kNumLevels for TEST LastLevelCompaction
3 maanden geleden
ArcueidType
a75a5f5c4d
handle last level
3 maanden geleden
李畅
43fe2f30ed
!NOT for USE! Compact last level
3 maanden geleden
李畅
b3f7582be3
slight change
3 maanden geleden
ArcueidType
2d970272b0
add a TODO
3 maanden geleden
ArcueidType
8edba27b88
add delete db for all tests
3 maanden geleden
ArcueidType
57cd670dcc
a naive version to pass ttl_test
3 maanden geleden
ArcueidType
78185e9e9c
optimize codes structure and paa ReadTTL test
3 maanden geleden
ArcueidType
a0cfce1188
Modify Put/Get methods for TTL support
3 maanden geleden
ssynn
879fd25d02
修改Readme
4 maanden geleden
ssynn
ec884a8bff
添加ttl测试用例
4 maanden geleden
Austin Sullivan
23e35d792b
Merge pull request #1202 from pkasting/main
[jumbo] Add begin()/end() to Slice.
5 maanden geleden
leveldb Team
eb31d19999
Allow compaction to finish in TEST_CompactRange
Waits for a current transaction to finish in TEST_CompactRange when the
`background_work_finished_signal_` signal may be emitted due to an error. This is a prospective fix for flaky crashes observed in b/351680196#comment5.
PiperOrigin-RevId: 663457574
6 maanden geleden
Peter Kasting
2cc36eb566
[jumbo] Add begin()/end() to Slice.
This allows this type to meet the requirements of e.g.
std::ranges::range, which is necessary for it to work with the
std::span range constructor, or the "non-legacy" constructor for
Chromium's base::span.
Bug: none
6 maanden geleden
leveldb Team
068d5ee1a3
leveldb: Check slice length in Footer::DecodeFrom()
Without this check decoding the footer in Table::Open() can read
uninitialized bytes from a buffer allocated on the stack if the file
was unexpectedly short.
In practice this is probably fine since this function validates a magic
number but MSan complains about branching on uninitialized data.
PiperOrigin-RevId: 525271012
1 jaar geleden
leveldb Team
c61238dcf3
Support Zstd compression level in Leveldb
PiperOrigin-RevId: 520556840
1 jaar geleden
Victor Costan
77d66aaf3e
Fix GitHub CI on Linux.
This PR temporarily removes a package that is currently broken on
GitHub's Ubuntu 22.04 installation. This is the most expedient way to
make the CI green again, so we can test any other changes we may want to
land.
PiperOrigin-RevId: 520206940
1 jaar geleden
Victor Costan
9cbbc5fb75
Merge pull request #1104 from reillyeon:chromium_env
PiperOrigin-RevId: 520172744
1 jaar geleden
Victor Costan
80d858fb2a
Merge pull request #1106 from reillyeon:run_many
PiperOrigin-RevId: 520171344
1 jaar geleden
leveldb Team
1d6e8d64ee
Add support for Zstd-based compression in LevelDB.
This change implements support for Zstd-based compression in LevelDB. Building
up from the Snappy compression (which has been supported since inception), this
change adds Zstd as an alternate compression algorithm.
We are implementing this to provide alternative options for users who might
have different performance and efficiency requirements. For instance, the
Zstandard website (https://facebook.github.io/zstd/ ) claims that the Zstd
algorithm can achieve around 30% higher compression ratios than Snappy, with
relatively smaller (~10%) slowdowns in de/compression speeds.
Benchmarking results:
$ blaze-bin/third_party/leveldb/db_bench
LevelDB: version 1.23
Date: Thu Feb 2 18:50:06 2023
CPU: 56 * Intel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHz
CPUCache: 35840 KB
Keys: 16 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 1000000
RawSize: 110.6 MB (estimated)
FileSize: 62.9 MB (estimated)
------------------------------------------------
fillseq : 2.613 micros/op; 42.3 MB/s
fillsync : 3924.432 micros/op; 0.0 MB/s (1000 ops)
fillrandom : 3.609 micros/op; 30.7 MB/s
overwrite : 4.508 micros/op; 24.5 MB/s
readrandom : 6.136 micros/op; (864322 of 1000000 found)
readrandom : 5.446 micros/op; (864083 of 1000000 found)
readseq : 0.180 micros/op; 613.3 MB/s
readreverse : 0.321 micros/op; 344.7 MB/s
compact : 827043.000 micros/op;
readrandom : 4.603 micros/op; (864105 of 1000000 found)
readseq : 0.169 micros/op; 656.3 MB/s
readreverse : 0.315 micros/op; 350.8 MB/s
fill100K : 854.009 micros/op; 111.7 MB/s (1000 ops)
crc32c : 1.227 micros/op; 3184.0 MB/s (4K per op)
snappycomp : 3.610 micros/op; 1081.9 MB/s (output: 55.2%)
snappyuncomp : 0.691 micros/op; 5656.3 MB/s
zstdcomp : 15.731 micros/op; 248.3 MB/s (output: 44.1%)
zstduncomp : 4.218 micros/op; 926.2 MB/s
PiperOrigin-RevId: 509957778
2 jaren geleden
Reilly Grant
13ebad24dc
Address comments.
1 jaar geleden
Reilly Grant
df68d9578c
Fix EnvTest.RunMany to allow parallel execution
As allowed by the documentation for Env::Schedule(), ChromiumEnv may
execute functions on multiple threads and guarantees no sequencing.
EnvTest.RunMany assumed that functions ran in order, is the case for the
stock PosixEnv and WindowsEnv implementations. This change updates the
test to not assume sequential execution.
1 jaar geleden
Reilly Grant
bfae97ff7d
Roll third_party/benchmark to f7547e29cc
Fixes an unused variable warning.
1 jaar geleden
Reilly Grant
89ea7f2643
Fix tests when run against ChromiumEnv
There are a couple differences between ChromiumEnv and
PosixEnv/WindowsEnv which cause test failures that are fixed (or at
least patched over) in this change:
* NewSequentialFile() and NewRandomAccessFile() return Status::IOError
rather than Status::NotFound when a file is not found, due to
https://crbug.com/760362 . This means a few tests need to expect a
different error result.
* GetChildren() never returns the '.' or '..' entries.
* As allowed by the documentation for Env::Schedule(), ChromiumEnv may
execute functions on multiple threads and guarantees no sequencing.
EnvTest.RunMany assumed that functions ran in order. The test has been
updated.
1 jaar geleden
Sanjay Ghemawat
fb644cb445
Stop future writes if a log file Close() fails.
See https://github.com/google/leveldb/issues/1081
PiperOrigin-RevId: 499519182
2 jaren geleden
leveldb Team
aa5479bbf4
Fix maintenance text
PiperOrigin-RevId: 461725664
2 jaren geleden
Victor Costan
ca684d00b5
Fix Markdown formatting in README.
PiperOrigin-RevId: 461722304
2 jaren geleden
leveldb Team
7b650f85de
Add note on current development state
PiperOrigin-RevId: 461695246
2 jaren geleden
Victor Costan
0a9b7b8e95
Merge pull request #1036 from chjj:benchmark-compression
PiperOrigin-RevId: 461612590
2 jaren geleden
leveldb Team
fff74f20ff
Use GTEST_SKIP in leveldb:table_test
This replaces a usage of fprintf to stderr
PiperOrigin-RevId: 454620969
2 jaren geleden
Christopher Jeffrey
9e1c274074
Add compression flag to benchmarks.
2 jaren geleden
Victor Costan
d019e3605f
Merge pull request #1008 from pkasting:main
PiperOrigin-RevId: 447466466
2 jaren geleden