openstack/swift - swift - OpenDev: Free Software Needs Free Tools

This change replaces WebOb with a mostly compatible local library,
swift.common.swob. Subtle changes to WebOb's API over the years have been a
huge headache. Swift doesn't even run on the current version.
There are a few incompatibilities to simplify the implementation/interface:
 * It only implements the header properties we use. More can be easily added.
 * Casts header values to str on assignment.
 * Response classes ("HTTPNotFound") are no longer subclasses, but partials
 on Response, so things like isinstance no longer work on them.
 * Unlike newer webob versions, will never return unicode objects.
Change-Id: I76617a0903ee2286b25a821b3c935c86ff95233f

Change-Id: If45f77fda269ae6e251579542e70eb71bd11fe2a

Abstracts fdatasync/fsync/fcntl into an FsyncWrapper to determine, the
first time it is used, which fsync-like call is supported on the host
platform:
 - Linux: use fdatasync(fd) as Swift already does today.
 - Darwin: use fcntl(fd, F_FULLFSYNC), since Darwin provides the
 F_FULLFSYNC flag when you wish to fsync data you care about, ensuring
 that it is written to disk and not simply a buffer.
 - BSD/Other: use fsync for non-Darwin BSDs and as a fallback for other
 platforms.
Change-Id: Ibcfdeef7843b2f10cf8a17a6b989038ea2364376

simplify, reduce the amount of code
Change-Id: I443a43030291f35a0b283cdd036cb09ec2ef9444

Change-Id: I04be779539b2bff76e2f614f50ddba2592fe4a36

This fixes an issue where Request objects (and related objects) were
not getting garbage collected when a 499 (client disconnect) occurred
for responses that still would have had more than the proxy server's
client chunk size left to send.
Fixed bug #1055834
Change-Id: Ib7b5fffe970dcdec60b90a9bdcd67c49b68fb914

I think not doing this was setting the SIGPIPE handler to signal.SIG_DFL
instead of the Python default of signal.SIG_IGN. This could cause other
tests which make a client stop reading before all data "chunks" are read
to fail harder than they should (i.e. the SIGPIPE there is benign and
even expected--the other side of the socket really did get closed
early).
Change-Id: I946a1913714a34ec677b701a2b5724bc8b715f70

Catches an IOError that is thrown when starting Swift on BSD-based
platforms, as the underlying system call to flush returns errno 9 (bad
file descriptor), whereas on Linux it succeeds.
Change-Id: Ic143d2fe6c3e1e0b39794958b40b0f5efdc17c06

Resolves an issue preventing Swift from starting on BSD-based platforms
that do not have this TCP flag (FreeBSD, OSX/Darwin, OpenBSD); identical
to Glance bug 879195, change I2f062a34, Glance commit efcdac36
(originally reported and patched by Brian Waldon).
Change-Id: Ifd696fe1080464d060e608c075ad0c113baab5ab

Change-Id: Id398b4c0764ca0995cec03c5f0ea6198ef877ade

Change-Id: I5a5ac8b5f18e077105ab12e9b1f0ccafac3983f7

replace a value set with utils.TRUE_VALUES, and fix some pep8 issues
Change-Id: If4db41d0d538afddee0d78449d229ce319c5efba

Fixes LP Bug #1051125
Change-Id: If1f96e1d759276cafd5378b4e74b0dbcb1fa2358

Have builder.add_devs get the next id to use when adding a new device
if its not specified in the dict.
Change-Id: I5a0defab43f5cfc5d997080bfd8563bfe72368ad

Change-Id: Ie5e88178e061955aea8759e5451a2d33ccc76511

Change-Id: I8130e258d77f47bfa28ecf79a51a6e34671ada22

On some systems (eg Illumos), posix_fallocate() returns
EINVAL when the underlying filesystem doesn't support the
operation. On Linux, the fallocate() call returns
EOPNOTSUPP.
The need for this patch was revealed by Victor Rodionov
<victor.rodionov@nexenta.com>.
Change-Id: I06fa9d49e7ec4084135843b7e0c91948dc098d27

Fixes Bug 1049081
Change-Id: If977080350cc5cdb6bc633b6af7d3c490ed23d46

Change-Id: If02b573353dedea9c2368ce4733fe97599229b2e

This change refactors container_info to return a dict instead of a tuple
with 6 (and counting...) values.
Also adds container size to cached info.
Change-Id: If68a06ab170504fbf07323354f3d0e073850493d

Change previously hard-coded constants into config variables. This
allows deployers to tune their cluster more specifically based on
their needs. For example, a deployment that uses direct swift access
for public content may need to set a larger header value constraint to
allow for the full object name to be represented in the Content-
Disposition header (which browsers check to determine the name of a
downloaded object).
The new settings are set in the [swift-constraints] section of
/etc/swift/swift.conf. Comments were also added to this config file.
Cleaned up swift/common/constraints.py to pass pep8 1.3.3
Funtional tests now require constraints to be defined in /etc/test.conf or in
/etc/swift/swift.conf (in the case of running the functional tests against a
local swift cluster). To have any hope of tests passing, the defined
constraints must match the constraints on the tested cluster.
Removed a ton of "magic numbers" in both unit and functional tests.
Change-Id: Ie4588e052fd158314ddca6cd8fca9bc793311465

Fix pep8 issues in swift/obj/expirer.py
Change-Id: Iba80aa5010f0c23e7fe1e5abc230a1c7f76687a8

Fix pep8 issues in swift/obj/auditor.py
Change-Id: Iae6fe2c7399fd52455d66ba57360e2f7d9e017f3

This moves search_devs into RingBuilder to make it accessible to other utils
that need to search the builder. Along the same lines this also adds a
load() call to get a RingBuilder instance when working with the builder files.
- This adds python-mock >= 0.7 as a dependency for unittests. On Ubuntu
 10.04 you'll have to pip install it, on 12.04 you can apt-get install
 it. Fedora 17+ should be able to yum install it.
- new pep8 compliance
- Fixed a small issue (undefined var) in swift-ring-builder when remove was
called but failed to find a match.
Change-Id: I2e02684235aa2f4e901a00858ae037091594c545

fix some format according to pep8
Change-Id: I8ceb266d92c8997f131fa4096aaa6cfd4d585aaa

fir some format according to pep8
Change-Id: Iec8f67ea2166c955732bd598661140d4cfce6d40

format some code according to pep8
	modified: auditor.py
	modified: reaper.py
	modified: server.py
Change-Id: Ic6d8e000c711d17dcd9047cfeee7876b23ff0605

If a partition directory was a file instead of a directory, the
object-replicator would attempt to listdir() it, raise an exception, and
try again next iteration. This condition could arise after running
xfs_repair.
Now, collect_jobs() will reap any partition directories which are
actually files. Fixes bug 1045954.
Change-Id: Id65d3eab2effd61c3f6b25250611c88c907b2a16

Change-Id: Ieeee2411f84489ea106909e18e758fd170aa9bca

Change-Id: Ie3423ce90d906948a1ce2db0efe3da184e60f6e0