key/value store optimized for disk storage

Wed May 2 22:46:20 EDT 2012

Steve Howell <showell30 at yahoo.com> writes:
> keys are file paths
> directories are 2 levels deep (30 dirs w/100k files each)
> values are file contents

> The current solution isn't horrible, 

Yes it is ;-)
> As I mention up top, I'm mostly hoping folks can point me toward
> sources they trust, whether it be other mailing lists, good tools,

cdb sounds reasonable for your purposes. I'm sure there are python
bindings for it.
http://cr.yp.to/cdb.html mentions a 4gb limit (2**32) but I
half-remember something about a 64 bit version.