external/leveldb.git
3 months agoRelease LevelDB 1.17 master
cmumford@chromium.org [Thu, 1 May 2014 21:32:34 +0000 (21:32 +0000)]
Release LevelDB 1.17

- Cleanup: delete unused IntSetToString

  It was added in http://cr/19491949 (and was referenced at the time).
  The last reference was removed in http://cr/19507363.

  This fixes warning/error with pre-release crosstoolv18:
  'std::string leveldb::{anonymous}::IntSetToString(const std::set<long unsigned int>&)' defined but not used [-Werror=unused-function]

- Added arm64 and and armv7s to IOS build as suggested on leveldb mailing list.

- Changed local variable type from int to size_t

  This eliminates compiler warning/error and resolves
  https://code.google.com/p/leveldb/issues/detail?id=140

git-svn-id: http://leveldb.googlecode.com/svn/trunk@80 62dab493-f737-651d-591e-8d6aee1b9529

6 months agoRelease LevelDB 1.16
dgrogan@chromium.org [Mon, 10 Feb 2014 19:52:59 +0000 (19:52 +0000)]
Release LevelDB 1.16

- Make Log::Reader not report a corruption when the last record in a
  log file is truncated.
- Fix issue 224: variable created but not utilized.
- Remove comment that referenced a removed feature.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@79 62dab493-f737-651d-591e-8d6aee1b9529

8 months agoRelease LevelDB 1.15
dgrogan@chromium.org [Tue, 10 Dec 2013 19:01:22 +0000 (19:01 +0000)]
Release LevelDB 1.15

- switched from mmap based writing to simpler stdio based writing. Has a
  minor impact (0.5 microseconds) on microbenchmarks for asynchronous
  writes. Synchronous writes speed up from 30ms to 10ms on linux/ext4.
  Should be much more reliable on diverse platforms.
- compaction errors now immediately put the database into a read-only
  mode (until it is re-opened). As a downside, a disk going out of
  space and then space being created will require a re-open to recover
  from, whereas previously that would happen automatically. On the
  plus side, many corruption possibilities go away.
- force the DB to enter an error-state so that all future writes fail
  when a synchronous log write succeeds but the sync fails.
- repair now regenerates sstables that exhibit problems
- fix issue 218 - Use native memory barriers on OSX
- fix issue 212 - QNX build is broken
- fix build on iOS with xcode 5
- make tests compile and pass on windows

git-svn-id: http://leveldb.googlecode.com/svn/trunk@78 62dab493-f737-651d-591e-8d6aee1b9529

11 months agoRelease LevelDB 1.14
dgrogan@chromium.org [Thu, 19 Sep 2013 20:51:19 +0000 (20:51 +0000)]
Release LevelDB 1.14

Fix issues 200, 201

Also,
* Fix link to bigtable paper in docs.
* New sstables will have the file extension .ldb. .sst files will
continue to be recognized.
* When building for iOS, use xcrun to execute the compiler. This may
affect issue 177.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@77 62dab493-f737-651d-591e-8d6aee1b9529

12 months agoLevelDB 1.13
dgrogan@chromium.org [Wed, 21 Aug 2013 18:40:07 +0000 (18:40 +0000)]
LevelDB 1.13

Fix issues 77, 87, 182, 190.

Additionally, fix the bug described in
https://groups.google.com/d/msg/leveldb/yL6h1mAOc20/vLU64RylIdMJ
where a large contiguous keyspace of deleted data was not getting
compacted.

Also fix a bug where options.max_open_files was not getting clamped
properly.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@76 62dab493-f737-651d-591e-8d6aee1b9529

14 months agoRelease leveldb 1.12
dgrogan@chromium.org [Tue, 18 Jun 2013 18:03:39 +0000 (18:03 +0000)]
Release leveldb 1.12

Non-functional changes only:
1) Add Kevin Regan to the AUTHORS file
2) Add standard license header to issues/issue178_test.cc

git-svn-id: http://leveldb.googlecode.com/svn/trunk@75 62dab493-f737-651d-591e-8d6aee1b9529

14 months agoRelease leveldb 1.11
dgrogan@chromium.org [Thu, 13 Jun 2013 23:22:15 +0000 (23:22 +0000)]
Release leveldb 1.11

Fixes issues
161
174
178

As well as the issue reported by edouarda14@gmail.com about
MissingSSTFile unit test failing on windows.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@74 62dab493-f737-651d-591e-8d6aee1b9529

15 months agoRelease leveldb 1.10
dgrogan@chromium.org [Wed, 15 May 2013 00:06:55 +0000 (00:06 +0000)]
Release leveldb 1.10

Fixes issues
147 - thanks feniksgordonfreeman
153
156
166

Additionally,
* Remove calls to exit(1).
* Fix unused-variable warnings from clang.
* Fix possible overflow error related to num_restart value >= (2^32/4).
* Add leveldbutil to .gitignore.
* Add better log messages when Write is stalled on a compaction.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@73 62dab493-f737-651d-591e-8d6aee1b9529

18 months agoMake DB::Open fail if sst files are missing.
dgrogan@chromium.org [Thu, 7 Feb 2013 02:28:39 +0000 (02:28 +0000)]
Make DB::Open fail if sst files are missing.

Also, cleanup for Clang's -Wimplicit-fallthrough warning.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@72 62dab493-f737-651d-591e-8d6aee1b9529

19 months agoFix corruption bug found and analyzed by dhruba@gmail.com
dgrogan@chromium.org [Mon, 7 Jan 2013 21:28:18 +0000 (21:28 +0000)]
Fix corruption bug found and analyzed by dhruba@gmail.com

https://groups.google.com/d/msg/leveldb/Kc9JxuIUu5A/9P0N9RL4ar8J

git-svn-id: http://leveldb.googlecode.com/svn/trunk@71 62dab493-f737-651d-591e-8d6aee1b9529

19 months agoadded utility to dump leveldb files
sanjay@google.com [Thu, 27 Dec 2012 18:43:59 +0000 (18:43 +0000)]
added utility to dump leveldb files

git-svn-id: http://leveldb.googlecode.com/svn/trunk@70 62dab493-f737-651d-591e-8d6aee1b9529

22 months agoRelease 1.7 contains small fixes.
sanjay@google.com [Tue, 16 Oct 2012 23:22:36 +0000 (23:22 +0000)]
Release 1.7 contains small fixes.

Details:
* Fix shared library building.
* Reorganize linking commands so flags like --as-needed can be passed.
* C binding exports version numbers.
* Fix small typos in documention.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@69 62dab493-f737-651d-591e-8d6aee1b9529

22 months agoUpdate to leveldb 1.6
dgrogan@chromium.org [Fri, 12 Oct 2012 19:13:17 +0000 (19:13 +0000)]
Update to leveldb 1.6

Highlights
----------
Mmap at most 1000 files on Posix to improve performance for large databases.
Support for more architectures (thanks to Alexander K.)

Building and porting
--------------------
HP/UX support (issue 126)
AtomicPointer for ia64 (issue 123)
Sparc v9 support (issue 124)
Atomic ops for powerpc
Use -fno-builtin-memcmp only when using g++
Simplify IOS build rules (issue 114)
Use CXXFLAGS instead of CFLAGS when invoking C++ compiler (issue 118)
Fix snappy shared library problem (issue 94)
Fix shared library installation path regression
Endian-ness detection tweak for FreeBSD

Bug fixes
---------
Stop ignoring FLAGS_open_files in db_bench
Make bloom test behavior agnostic to endian-ness

Performance
-----------
Limit number of mmapped files to 1000 to improve perf for large dbs
Do not delay for 1 second on shutdown path (issue 125)

Misc
----
Make InMemoryEnv return a no-op logger
C binding now has a wrapper for free (issue 117)
Add thread-safety annotations
Added an in-process lock table (issue 120)
Make RandomAccessFile and SequentialFile non-copyable

git-svn-id: http://leveldb.googlecode.com/svn/trunk@68 62dab493-f737-651d-591e-8d6aee1b9529

2 years agoupdate version number to 1.5
sanjay@google.com [Wed, 30 May 2012 16:58:57 +0000 (16:58 +0000)]
update version number to 1.5

git-svn-id: http://leveldb.googlecode.com/svn/trunk@67 62dab493-f737-651d-591e-8d6aee1b9529

2 years agoRemove static initializer; fix endian-ness detection; fix build on various platforms...
sanjay@google.com [Wed, 30 May 2012 16:53:11 +0000 (16:53 +0000)]
Remove static initializer; fix endian-ness detection; fix build on various platforms; improve android port speed

git-svn-id: http://leveldb.googlecode.com/svn/trunk@66 62dab493-f737-651d-591e-8d6aee1b9529

2 years agoAdded bloom filter support
sanjay@google.com [Tue, 17 Apr 2012 15:48:25 +0000 (15:48 +0000)]
Added bloom filter support

git-svn-id: http://leveldb.googlecode.com/svn/trunk@65 62dab493-f737-651d-591e-8d6aee1b9529

2 years agobuild shared libraries; updated version to 1.3; add Status accessors
sanjay@google.com [Fri, 30 Mar 2012 20:18:06 +0000 (20:18 +0000)]
build shared libraries; updated version to 1.3; add Status accessors

git-svn-id: http://leveldb.googlecode.com/svn/trunk@64 62dab493-f737-651d-591e-8d6aee1b9529

2 years agoBuild fixes and cleanups git-svn
sanjay@google.com [Wed, 21 Mar 2012 17:32:19 +0000 (17:32 +0000)]
Build fixes and cleanups

git-svn-id: http://leveldb.googlecode.com/svn/trunk@63 62dab493-f737-651d-591e-8d6aee1b9529

2 years agouse mmap on 64-bit machines to speed-up reads; small build fixes
sanjay@google.com [Thu, 15 Mar 2012 16:24:26 +0000 (16:24 +0000)]
use mmap on 64-bit machines to speed-up reads; small build fixes

git-svn-id: http://leveldb.googlecode.com/svn/trunk@62 62dab493-f737-651d-591e-8d6aee1b9529

2 years agofix LOCK file deletion to prevent crash on windows
sanjay@google.com [Fri, 9 Mar 2012 15:53:05 +0000 (15:53 +0000)]
fix LOCK file deletion to prevent crash on windows

git-svn-id: http://leveldb.googlecode.com/svn/trunk@61 62dab493-f737-651d-591e-8d6aee1b9529

2 years agoadded group commit; drastically speeds up mult-threaded synchronous write workloads
sanjay@google.com [Fri, 9 Mar 2012 00:27:49 +0000 (00:27 +0000)]
added group commit; drastically speeds up mult-threaded synchronous write workloads

git-svn-id: http://leveldb.googlecode.com/svn/trunk@60 62dab493-f737-651d-591e-8d6aee1b9529

2 years agoadd .gitignore; support for building on a few BSD variants
sanjay@google.com [Mon, 5 Mar 2012 18:38:07 +0000 (18:38 +0000)]
add .gitignore; support for building on a few BSD variants

git-svn-id: http://leveldb.googlecode.com/svn/trunk@59 62dab493-f737-651d-591e-8d6aee1b9529

2 years agoavoid very large compactions; fix build on Linux
sanjay@google.com [Fri, 3 Feb 2012 16:16:14 +0000 (16:16 +0000)]
avoid very large compactions; fix build on Linux

git-svn-id: http://leveldb.googlecode.com/svn/trunk@58 62dab493-f737-651d-591e-8d6aee1b9529

2 years agofixed issues 66 (leaking files on disk error) and 68 (no sync of CURRENT file)
sanjay@google.com [Wed, 25 Jan 2012 23:07:20 +0000 (23:07 +0000)]
fixed issues 66 (leaking files on disk error)  and 68 (no sync of CURRENT file)

git-svn-id: http://leveldb.googlecode.com/svn/trunk@57 62dab493-f737-651d-591e-8d6aee1b9529

2 years agoMakefile fixes for systems with $CXX other than g++.
hans@chromium.org [Wed, 30 Nov 2011 11:08:02 +0000 (11:08 +0000)]
Makefile fixes for systems with $CXX other than g++.

- Makefile: Use $(CXX) for compiling C++ files,
  don't override the environment's value of $CXX

- build_detect_platform: use $CXX instead of g++.

Based on bug report from Theo Schlossnagle:
http://code.google.com/p/leveldb/issues/detail?id=46

(Sync with uptream at 25807040.)

git-svn-id: http://leveldb.googlecode.com/svn/trunk@56 62dab493-f737-651d-591e-8d6aee1b9529

2 years agoPass system's CFLAGS, remove exit time destructor, sstable bug fix.
hans@chromium.org [Mon, 14 Nov 2011 17:21:42 +0000 (17:21 +0000)]
Pass system's CFLAGS, remove exit time destructor, sstable bug fix.

- Pass system's values of CFLAGS,LDFLAGS.
  Don't override OPT if it's already set.
  Original patch by Alessio Treglia <alessio@debian.org>:
  http://code.google.com/p/leveldb/issues/detail?id=27#c6

- Remove 1 exit time destructor from leveldb.
  See http://crbug.com/101600

- Fix problem where sstable building code would pass an
  internal key to the user comparator.

(Sync with uptream at 25436817.)

git-svn-id: http://leveldb.googlecode.com/svn/trunk@55 62dab493-f737-651d-591e-8d6aee1b9529

2 years agoA number of fixes:
hans@chromium.org [Mon, 31 Oct 2011 17:34:55 +0000 (17:34 +0000)]
A number of fixes:

- Replace raw slice comparison with a call to user comparator.
  Added test for custom comparators.

- Fix end of namespace comments.

- Fixed bug in picking inputs for a level-0 compaction.

  When finding overlapping files, the covered range may expand
  as files are added to the input set.  We now correctly expand
  the range when this happens instead of continuing to use the
  old range.  For example, suppose L0 contains files with the
  following ranges:

      F1: a .. d
      F2:    c .. g
      F3:       f .. j

  and the initial compaction target is F3.  We used to search
  for range f..j which yielded {F2,F3}.  However we now expand
  the range as soon as another file is added.  In this case,
  when F2 is added, we expand the range to c..j and restart the
  search.  That picks up file F1 as well.

  This change fixes a bug related to deleted keys showing up
  incorrectly after a compaction as described in Issue 44.

(Sync with upstream @25072954)

git-svn-id: http://leveldb.googlecode.com/svn/trunk@54 62dab493-f737-651d-591e-8d6aee1b9529

2 years agoA number of bugfixes:
gabor@google.com [Wed, 5 Oct 2011 23:34:24 +0000 (23:34 +0000)]
A number of bugfixes:

- Added DB::CompactRange() method.

  Changed manual compaction code so it breaks up compactions of
  big ranges into smaller compactions.

  Changed the code that pushes the output of memtable compactions
  to higher levels to obey the grandparent constraint: i.e., we
  must never have a single file in level L that overlaps too
  much data in level L+1 (to avoid very expensive L-1 compactions).

  Added code to pretty-print internal keys.

- Fixed bug where we would not detect overlap with files in
  level-0 because we were incorrectly using binary search
  on an array of files with overlapping ranges.

  Added "leveldb.sstables" property that can be used to dump
  all of the sstables and ranges that make up the db state.

- Removing post_write_snapshot support.  Email to leveldb mailing
  list brought up no users, just confusion from one person about
  what it meant.

- Fixing static_cast char to unsigned on BIG_ENDIAN platforms.

  Fixes  Issue 35 and Issue 36.

- Comment clarification to address leveldb Issue 37.

- Change license in posix_logger.h to match other files.

- A build problem where uint32 was used instead of uint32_t.

Sync with upstream @24408625

git-svn-id: http://leveldb.googlecode.com/svn/trunk@53 62dab493-f737-651d-591e-8d6aee1b9529

2 years agoSync with upstream @24213649.
hans@chromium.org [Mon, 26 Sep 2011 16:46:40 +0000 (16:46 +0000)]
Sync with upstream @24213649.

Adding GNU/kFreeBSD support. As requested here:
http://code.google.com/p/leveldb/issues/detail?id=38

Use uint64_t instead of size_t in MemEnvTest. As pointed out at
http://code.google.com/p/leveldb/issues/detail?id=41

git-svn-id: http://leveldb.googlecode.com/svn/trunk@52 62dab493-f737-651d-591e-8d6aee1b9529

2 years agoSync with upstream @23860137.
gabor@google.com [Thu, 15 Sep 2011 21:01:32 +0000 (21:01 +0000)]
Sync with upstream @23860137.

Fix GCC -Wshadow warnings in LevelDB's public header files,
reported by Dustin.

Add in-memory Env implementation (helpers/memenv/*).
This enables users to create LevelDB databases in-memory.

Initialize ShardedLRUCache::last_id_ to zero.
This fixes a Valgrind warning.

(Also delete port/sha1_* which were removed upstream some time ago.)

git-svn-id: http://leveldb.googlecode.com/svn/trunk@51 62dab493-f737-651d-591e-8d6aee1b9529

2 years agoBugfixes: for Get(), don't hold mutex while writing log.
gabor@google.com [Thu, 1 Sep 2011 19:08:02 +0000 (19:08 +0000)]
Bugfixes: for Get(), don't hold mutex while writing log.

- Fix bug in Get: when it triggers a compaction, it could sometimes
  mark the compaction with the wrong level (if there was a gap
  in the set of levels examined for the Get).

- Do not hold mutex while writing to the log file or to the
  MANIFEST file.

  Added a new benchmark that runs a writer thread concurrently with
  reader threads.

  Percentiles
  ------------------------------
  micros/op: avg  median 99   99.9  99.99  99.999 max
  ------------------------------------------------------
  before:    42   38     110  225   32000  42000  48000
  after:     24   20     55   65    130    1100   7000

- Fixed race in optimized Get.  It should have been using the
  pinned memtables, not the current memtables.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@50 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoBugfix for issue 33; reduce lock contention in Get(), parallel benchmarks.
gabor@google.com [Mon, 22 Aug 2011 21:08:51 +0000 (21:08 +0000)]
Bugfix for issue 33; reduce lock contention in Get(), parallel benchmarks.

- Fix for issue 33 (non-null-terminated result from
  leveldb_property_value())

- Support for running multiple instances of a benchmark in parallel.

- Reduce lock contention on Get():
  (1) Do not hold the lock while searching memtables.
  (2) Shard block and table caches 16-ways.

  Benchmark for evaluating this change:
  $ db_bench --benchmarks=fillseq1,readrandom --threads=$n
  (fillseq1 is a small hack to make sure fillseq runs once regardless
  of number of threads specified on the command line).

git-svn-id: http://leveldb.googlecode.com/svn/trunk@49 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoBugfixes for iterator and documentation.
gabor@google.com [Tue, 16 Aug 2011 01:21:01 +0000 (01:21 +0000)]
Bugfixes for iterator and documentation.

- Fix bug in Iterator::Prev where it would return the wrong key.
  Fixes issues 29 and 30.

- Added a tweak to testharness to allow running just some tests.

- Fixing two minor documentation errors based on issues 28 and 25.

- Cleanup; fix namespaces of export-to-C code.
  Also fix one "const char*" vs "char*" mismatch.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@48 62dab493-f737-651d-591e-8d6aee1b9529

3 years ago@23023120
dgrogan@chromium.org [Sat, 6 Aug 2011 00:19:37 +0000 (00:19 +0000)]
@23023120

git-svn-id: http://leveldb.googlecode.com/svn/trunk@47 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoC binding for leveldb, better readseq benchmark for SQLite.
gabor@google.com [Fri, 5 Aug 2011 20:40:49 +0000 (20:40 +0000)]
C binding for leveldb, better readseq benchmark for SQLite.

- Added a C binding for LevelDB.
  May be useful as a stable ABI that can be used by
  programs that keep leveldb in a shared library,
  or for JNI API.

- Replaced SQLite's readseq benchmark to a more efficient version.
  SQLite readseq speeds increased by about a factor of 2x
  from the previous version. Also updated benchmark page to
  reflect readseq speed up.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@46 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoImproved benchmark, fixed bugs and SQLite parameters.
gabor@google.com [Fri, 29 Jul 2011 21:35:05 +0000 (21:35 +0000)]
Improved benchmark, fixed bugs and SQLite parameters.

- Based on suggestions on the sqlite-users mailing list,
  we removed the superfluous index on the primary key
  for SQLite's benchmarks, and turned write-ahead logging
  ("WAL") on. This led to performance improvements for SQLite.

- Based on a suggestion by Florian Weimer on the leveldb
  mailing list, we disabled hard drive write-caching via
  hdparm when testing synchronous writes. This led to
  performance losses for LevelDB and Kyoto TreeDB.

- Fixed a mistake in 2.A.->Random where the bar sizes
  were switched for Kyoto TreeDB and SQLite.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@45 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoMinor typos in benchmark page.
gabor@google.com [Wed, 27 Jul 2011 14:29:59 +0000 (14:29 +0000)]
Minor typos in benchmark page.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@44 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoMinor edit in benchmark page.
gabor@google.com [Wed, 27 Jul 2011 04:39:46 +0000 (04:39 +0000)]
Minor edit in benchmark page.

(Baseline comparison does not make sense for large values.)

git-svn-id: http://leveldb.googlecode.com/svn/trunk@43 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoSetting SVN mime-type for benchmark page.
gabor@google.com [Wed, 27 Jul 2011 01:56:52 +0000 (01:56 +0000)]
Setting SVN mime-type for benchmark page.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@42 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoAdding doctype to benchmark page so Google Code displays it as HTML.
gabor@google.com [Wed, 27 Jul 2011 01:49:08 +0000 (01:49 +0000)]
Adding doctype to benchmark page so Google Code displays it as HTML.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@41 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoAdding FreeBSD support, removing Chromium files, adding benchmark.
gabor@google.com [Wed, 27 Jul 2011 01:46:25 +0000 (01:46 +0000)]
Adding FreeBSD support, removing Chromium files, adding benchmark.

- LevelDB patch for FreeBSD. This resolves Issue 22.
  Contributed by dforsythe (thanks!).

- Removing Chromium-specific files.
  They are now going to live in the Chromium repository.

- Adding a benchmark page comparing LevelDB performance
  to SQLite and Kyoto Cabinet's TreeDB, along with
  code to generate the benchmarks.
  Thanks to Kevin Tseng for compiling the benchmarks,
  and Scott Hess and Mikio Hirabayashi for their
  help and advice.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@40 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoSpeed up Snappy uncompression, new Logger interface.
gabor@google.com [Thu, 21 Jul 2011 02:40:18 +0000 (02:40 +0000)]
Speed up Snappy uncompression, new Logger interface.

- Removed one copy of an uncompressed block contents changing
  the signature of Snappy_Uncompress() so it uncompresses into a
  flat array instead of a std::string.

  Speeds up readrandom ~10%.

- Instead of a combination of Env/WritableFile, we now have a
  Logger interface that can be easily overridden applications
  that want to supply their own logging.

- Separated out the gcc and Sun Studio parts of atomic_pointer.h
  so we can use 'asm', 'volatile' keywords for Sun Studio.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@39 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoSun Studio support, and fix for test related memory fixes.
gabor@google.com [Tue, 19 Jul 2011 23:36:47 +0000 (23:36 +0000)]
Sun Studio support, and fix for test related memory fixes.

- LevelDB patch for Sun Studio
  Based on a patch submitted by Theo Schlossnagle - thanks!
  This fixes Issue 17.

- Fix a couple of test related memory leaks.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@38 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoSmall tweaks and bugfixes for Issue 18 and 19.
gabor@google.com [Fri, 15 Jul 2011 00:20:57 +0000 (00:20 +0000)]
Small tweaks and bugfixes for Issue 18 and 19.

Slight tweak to the no-overlap optimization: only push to
level 2 to reduce the amount of wasted space when the same
small key range is being repeatedly overwritten.

Fix for Issue 18: Avoid failure on Windows by avoiding
deletion of lock file until the end of DestroyDB().

Fix for Issue 19: Disregard sequence numbers when checking for
overlap in sstable ranges. This fixes issue 19: when writing
the same key over and over again, we would generate a sequence
of sstables that were never merged together since their sequence
numbers were disjoint.

Don't ignore map/unmap error checks.

Miscellaneous fixes for small problems Sanjay found while diagnosing
issue/9 and issue/16 (corruption_testr failures).
- log::Reader reports the record type when it finds an unexpected type.
- log::Reader no longer reports an error when it encounters an expected
  zero record regardless of the setting of the "checksum" flag.
- Added a missing forward declaration.
- Documented a side-effects of larger write buffer sizes
  (longer recovery time).

git-svn-id: http://leveldb.googlecode.com/svn/trunk@37 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoFixed a snappy compression wrapper bug (passing wrong variable).
gabor@google.com [Thu, 30 Jun 2011 23:17:03 +0000 (23:17 +0000)]
Fixed a snappy compression wrapper bug (passing wrong variable).

Change atomic_pointer.h to prefer a memory barrier based
implementation over a <cstdatomic> based implementation for
the following reasons:
(1) On a x86-32-bit gcc-4.4 build, <ctdatomic> was corrupting
    the AtomicPointer.
(2) On a x86-64-bit gcc build, a <ctstdatomic> based acquire-load
    takes ~15ns as opposed to the ~1ns for a memory-barrier
    based implementation.

Fixes issue 9 (corruption_test fails)
http://code.google.com/p/leveldb/issues/detail?id=9

Fixes issue 16 (CorruptionTest.MissingDescriptor fails)
http://code.google.com/p/leveldb/issues/detail?id=16

git-svn-id: http://leveldb.googlecode.com/svn/trunk@36 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoFixing Makefile issue reported in Issue 15 (misspelled flag)
gabor@google.com [Wed, 29 Jun 2011 22:53:17 +0000 (22:53 +0000)]
Fixing Makefile issue reported in Issue 15 (misspelled flag)

git-svn-id: http://leveldb.googlecode.com/svn/trunk@35 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoPlatform detection during build, plus compatibility patches for machines without...
gabor@google.com [Wed, 29 Jun 2011 00:30:50 +0000 (00:30 +0000)]
Platform detection during build, plus compatibility patches for machines without <cstdatomic>.

This revision adds two major changes:
1. build_detect_platform which generates build_config.mk
   with platform-dependent flags for the build process
2. /port/atomic_pointer.h with anAtomicPointerimplementation
   for platforms without <cstdatomic>

Some of this code is loosely based on patches submitted to the
LevelDB mailing list at https://groups.google.com/forum/#!forum/leveldb
Tip of the hat to Dave Smith and Edouard A, who both sent patches.

The presence of Snappy (http://code.google.com/p/snappy/) and
cstdatomic are now both detected in the build_detect_platform
script (1.) which gets executing during make.

For (2.), instead of broadly importing atomicops_* from Chromium or
the Google performance tools, we chose to just implement AtomicPointer
and the limited atomic load and store operations it needs.
This resulted in much less code and fewer files - everything is
contained in atomic_pointer.h.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@34 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoFixing issue 11: version_set_test.cc was missing
gabor@google.com [Wed, 22 Jun 2011 18:45:39 +0000 (18:45 +0000)]
Fixing issue 11: version_set_test.cc was missing

git-svn-id: http://leveldb.googlecode.com/svn/trunk@33 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoA number of smaller fixes and performance improvements:
gabor@google.com [Wed, 22 Jun 2011 02:36:45 +0000 (02:36 +0000)]
A number of smaller fixes and performance improvements:

- Implemented Get() directly instead of building on top of a full
  merging iterator stack.  This speeds up the "readrandom" benchmark
  by up to 15-30%.

- Fixed an opensource compilation problem.
  Added --db=<name> flag to control where the database is placed.

- Automatically compact a file when we have done enough
  overlapping seeks to that file.

- Fixed a performance bug where we would read from at least one
  file in a level even if none of the files overlapped the key
  being read.

- Makefile fix for Mac OSX installations that have XCode 4 without XCode 3.

- Unified the two occurrences of binary search in a file-list
  into one routine.

- Found and fixed a bug where we would unnecessarily search the
  last file when looking for a key larger than all data in the
  level.

- A fix to avoid the need for trivial move compactions and
  therefore gets rid of two out of five syncs in "fillseq".

- Removed the MANIFEST file write when switching to a new
  memtable/log-file for a 10-20% improvement on fill speed on ext4.

- Adding a SNAPPY setting in the Makefile for folks who have
  Snappy installed. Snappy compresses values and speeds up writes.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@32 62dab493-f737-651d-591e-8d6aee1b9529

3 years agosync with upstream @21706995
hans@chromium.org [Tue, 7 Jun 2011 14:40:26 +0000 (14:40 +0000)]
sync with upstream @21706995

Fixed race condition reported by Dave Smit (dizzyd@dizzyd,com)
on the leveldb mailing list.  We were not signalling
waiters after a trivial move from level-0.  The result was
that in some cases (hard to reproduce), a write would get
stuck forever waiting for the number of level-0 files to drop
below its hard limit.

The new code is simpler: there is just one condition variable
instead of two, and the condition variable is signalled after
every piece of background work finishes.  Also, all compaction
work (including for manual compactions) is done in the
background thread, and therefore we can remove the
"compacting_" variable.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@31 62dab493-f737-651d-591e-8d6aee1b9529

3 years agosync with upstream @21627589
dgrogan@chromium.org [Thu, 2 Jun 2011 00:00:37 +0000 (00:00 +0000)]
sync with upstream @21627589

Minor changes:
* Reformat the bodies of the iterator interface routines in IteratorWrapper to
  make them a bit easier to read
* Switched the default in the leveldb makefile to be optimized mode, rather
  than debug mode
* Fix build problem in chromium port

git-svn-id: http://leveldb.googlecode.com/svn/trunk@30 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoUpdate from upstream @21551990
dgrogan@chromium.org [Sat, 28 May 2011 00:53:58 +0000 (00:53 +0000)]
Update from upstream @21551990

* Patch LevelDB to build for OSX and iOS
* Fix race condition in memtable iterator deletion.
* Other small fixes.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@29 62dab493-f737-651d-591e-8d6aee1b9529

3 years agosync with upstream @ 21409451
dgrogan@chromium.org [Sat, 21 May 2011 02:17:43 +0000 (02:17 +0000)]
sync with upstream @ 21409451

Check the NEWS file for details of what changed.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@28 62dab493-f737-651d-591e-8d6aee1b9529

3 years agomake windows include /Iport\win in dependent projects
dgrogan@chromium.org [Tue, 3 May 2011 03:10:59 +0000 (03:10 +0000)]
make windows include /Iport\win in dependent projects

git-svn-id: http://leveldb.googlecode.com/svn/trunk@27 62dab493-f737-651d-591e-8d6aee1b9529

3 years agopull in hans' mac build fix
dgrogan@chromium.org [Thu, 21 Apr 2011 01:54:51 +0000 (01:54 +0000)]
pull in hans' mac build fix

git-svn-id: http://leveldb.googlecode.com/svn/trunk@26 62dab493-f737-651d-591e-8d6aee1b9529

3 years agofix build on at least linux
dgrogan@chromium.org [Wed, 20 Apr 2011 22:50:04 +0000 (22:50 +0000)]
fix build on at least linux

git-svn-id: http://leveldb.googlecode.com/svn/trunk@25 62dab493-f737-651d-591e-8d6aee1b9529

3 years ago@20776309
dgrogan@chromium.org [Wed, 20 Apr 2011 22:48:11 +0000 (22:48 +0000)]
@20776309
* env_chromium.cc should not export symbols.
* Fix MSVC warnings.
* Removed large value support.
* Fix broken reference to documentation file

git-svn-id: http://leveldb.googlecode.com/svn/trunk@24 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoreverting disastrous MOE commit, returning to r21
dgrogan@chromium.org [Tue, 19 Apr 2011 23:11:15 +0000 (23:11 +0000)]
reverting disastrous MOE commit, returning to r21

git-svn-id: http://leveldb.googlecode.com/svn/trunk@23 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoRevision created by MOE tool push_codebase.
dgrogan@chromium.org [Tue, 19 Apr 2011 23:01:25 +0000 (23:01 +0000)]
Revision created by MOE tool push_codebase.
MOE_MIGRATION=

git-svn-id: http://leveldb.googlecode.com/svn/trunk@22 62dab493-f737-651d-591e-8d6aee1b9529

3 years agochmod a-x
dgrogan@chromium.org [Mon, 18 Apr 2011 23:15:58 +0000 (23:15 +0000)]
chmod a-x

git-svn-id: http://leveldb.googlecode.com/svn/trunk@21 62dab493-f737-651d-591e-8d6aee1b9529

3 years ago@20602303. Default file permission is now 755.
dgrogan@chromium.org [Tue, 12 Apr 2011 19:38:58 +0000 (19:38 +0000)]
@20602303.  Default file permission is now 755.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@20 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoFix last commit
jorlow@chromium.org [Wed, 30 Mar 2011 18:49:03 +0000 (18:49 +0000)]
Fix last commit

git-svn-id: http://leveldb.googlecode.com/svn/trunk@19 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoMove include files into a leveldb subdir.
jorlow@chromium.org [Wed, 30 Mar 2011 18:35:40 +0000 (18:35 +0000)]
Move include files into a leveldb subdir.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@18 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoUpstream change.
jorlow@chromium.org [Tue, 29 Mar 2011 22:41:11 +0000 (22:41 +0000)]
Upstream change.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@17 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoUpstream changes.
jorlow@chromium.org [Mon, 28 Mar 2011 20:43:44 +0000 (20:43 +0000)]
Upstream changes.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@16 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoUpstream changes
jorlow@chromium.org [Fri, 25 Mar 2011 20:27:43 +0000 (20:27 +0000)]
Upstream changes

git-svn-id: http://leveldb.googlecode.com/svn/trunk@15 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoPull from upstream.
jorlow@chromium.org [Tue, 22 Mar 2011 23:24:02 +0000 (23:24 +0000)]
Pull from upstream.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@14 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoMake GetTestDirectory threadsafe within Chromium and make it work on Windows.
jorlow@chromium.org [Tue, 22 Mar 2011 19:07:54 +0000 (19:07 +0000)]
Make GetTestDirectory threadsafe within Chromium and make it work on Windows.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@13 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoMore changes from upstream.
jorlow@chromium.org [Tue, 22 Mar 2011 18:32:49 +0000 (18:32 +0000)]
More changes from upstream.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@12 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoRemoving unneeded build files
gabor@google.com [Mon, 21 Mar 2011 23:10:11 +0000 (23:10 +0000)]
Removing unneeded build files

git-svn-id: http://leveldb.googlecode.com/svn/trunk@11 62dab493-f737-651d-591e-8d6aee1b9529

3 years agomore upstream changes
jorlow@chromium.org [Mon, 21 Mar 2011 21:06:49 +0000 (21:06 +0000)]
more upstream changes

git-svn-id: http://leveldb.googlecode.com/svn/trunk@10 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoSync in bug fixes
jorlow@chromium.org [Mon, 21 Mar 2011 19:40:57 +0000 (19:40 +0000)]
Sync in bug fixes

git-svn-id: http://leveldb.googlecode.com/svn/trunk@9 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoChanges to get Snappy working
jorlow@chromium.org [Mon, 21 Mar 2011 19:09:55 +0000 (19:09 +0000)]
Changes to get Snappy working

git-svn-id: http://leveldb.googlecode.com/svn/trunk@8 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoOops, another file that didn't upload correctly.
jorlow@chromium.org [Mon, 21 Mar 2011 18:13:39 +0000 (18:13 +0000)]
Oops, another file that didn't upload correctly.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@7 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoSet mime-type to text/css on doc/doc.css files.
hans@chromium.org [Mon, 21 Mar 2011 17:30:49 +0000 (17:30 +0000)]
Set mime-type to text/css on doc/doc.css files.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@6 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoSet mime-type to text/html on .html files.
hans@chromium.org [Mon, 21 Mar 2011 17:22:12 +0000 (17:22 +0000)]
Set mime-type to text/html on .html files.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@5 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoFix typo in Makefile.
jorlow@chromium.org [Fri, 18 Mar 2011 23:03:49 +0000 (23:03 +0000)]
Fix typo in Makefile.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@4 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoDirectory paths were off a bit.
jorlow@chromium.org [Fri, 18 Mar 2011 22:47:28 +0000 (22:47 +0000)]
Directory paths were off a bit.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@3 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoInitial checkin.
jorlow@chromium.org [Fri, 18 Mar 2011 22:37:00 +0000 (22:37 +0000)]
Initial checkin.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@2 62dab493-f737-651d-591e-8d6aee1b9529

3 years agoInitial directory structure.
(no author) [Wed, 2 Mar 2011 17:37:17 +0000 (17:37 +0000)]
Initial directory structure.

git-svn-id: http://leveldb.googlecode.com/svn/trunk@1 62dab493-f737-651d-591e-8d6aee1b9529