Erasure Code Reconstructor

Code Issues Proposed changes

This patch adds the erasure code reconstructor. It follows the
design of the replicator but:
 - There is no notion of update() or update_deleted().
 - There is a single job processor
 - Jobs are processed partition by partition.
 - At the end of processing a rebalanced or handoff partition, the
 reconstructor will remove successfully reverted objects if any.
And various ssync changes such as the addition of reconstruct_fa()
function called from ssync_sender which performs the actual
reconstruction while sending the object to the receiver
Co-Authored-By: Alistair Coles <alistair.coles@hp.com>
Co-Authored-By: Thiago da Silva <thiago@redhat.com>
Co-Authored-By: John Dickinson <me@not.mn>
Co-Authored-By: Clay Gerrard <clay.gerrard@gmail.com>
Co-Authored-By: Tushar Gohad <tushar.gohad@intel.com>
Co-Authored-By: Samuel Merritt <sam@swiftstack.com>
Co-Authored-By: Christian Schwede <christian.schwede@enovance.com>
Co-Authored-By: Yuan Zhou <yuan.zhou@intel.com>
blueprint ec-reconstructor
Change-Id: I7d15620dc66ee646b223bb9fff700796cd6bef51

This commit is contained in:

paul luse

2014年10月28日 09:51:06 -07:00

committed by Clay Gerrard

parent b2189ef47a

commit 647b66a2ce

27 changed files with 5038 additions and 234 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

23
etc/object-server.conf-sample

View File

@@ -211,6 +211,29 @@ use = egg:swift#recon

# removed when it has successfully replicated to all the canonical nodes.

# handoff_delete = auto

[object-reconstructor]

# You can override the default log routing for this app here (don't use set!):

# Unless otherwise noted, each setting below has the same meaning as described

# in the [object-replicator] section, however these settings apply to the EC

# reconstructor

#

# log_name = object-reconstructor

# log_facility = LOG_LOCAL0

# log_level = INFO

# log_address = /dev/log

#

# daemonize = on

# run_pause = 30

# concurrency = 1

# stats_interval = 300

# node_timeout = 10

# http_timeout = 60

# lockup_timeout = 1800

# reclaim_age = 604800

# ring_check_interval = 15

# recon_cache_path = /var/cache/swift

# handoffs_first = False

[object-updater]

# You can override the default log routing for this app here (don't use set!):

# log_name = object-updater

Erasure Code Reconstructor

23 etc/object-server.conf-sample Unescape Escape View File

23
etc/object-server.conf-sample

View File