Add oldest failed async pending tracker

Code Issues Proposed changes

In the past we have had some async pendings that repeatedly fail for months at a time. This patch adds an OldestAsyncPendingTracker class which manages the tracking of the oldest async pending updates for each account-container pair. This class maintains timestamps for pending updates associated with account-container pairs. It evicts the newest pairs when the max_entries is reached. It supports retrieving the N oldest pending updates or calculating the age of the oldest pending update.
Change-Id: I6d9667d555836cfceda52708a57a1d29ebd1a80b

This commit is contained in:

Chinemerem

2024年10月09日 10:25:17 -07:00

parent b084744d02

commit 0a5348eb48

6 changed files with 382 additions and 6 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

6
etc/object-server.conf-sample

View File

@@ -528,6 +528,12 @@ use = egg:swift#backend_ratelimit

# Must be an integer value greater than or equal to 0.

# max_deferred_updates = 10000

#

# Maximum number of oldest async pending timestamps to track for each

# account-container pair.

# async_tracker_max_entries = 100

# Maximum number of oldest async pending timestamps to dump to recon cache.

# async_tracker_dump_count = 5

#

# slowdown will sleep that amount between objects. Deprecated; use

# objects_per_second instead.

# slowdown = 0.01

Add oldest failed async pending tracker

6 etc/object-server.conf-sample Unescape Escape View File

6
etc/object-server.conf-sample

View File