Add backend rate limiting middleware

Code Issues Proposed changes

This is a fairly blunt tool: ratelimiting is per device and
applied independently in each worker, but this at least provides
some limit to disk IO on backend servers.
GET, HEAD, PUT, POST, DELETE, UPDATE and REPLICATE methods may be
rate-limited.
Only requests with a path starting '<device>/<partition>', where
<partition> can be cast to an integer, will be rate-limited. Other
requests, including, for example, recon requests with paths such as
'recon/version', are unconditionally forwarded to the next app in the
pipeline.
OPTIONS and SSYNC methods are not rate-limited. Note that
SSYNC sub-requests are passed directly to the object server app
and will not pass though this middleware.
Change-Id: I78b59a081698a6bff0d74cbac7525e28f7b5d7c1

This commit is contained in:

Alistair Coles

2022年03月31日 16:36:32 +01:00

parent 507cf18f96

commit ccaf49a00c

11 changed files with 331 additions and 10 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

14
etc/account-server.conf-sample

View File

@@ -80,7 +80,7 @@ bind_port = 6202

# ionice_priority =

[pipeline:main]

pipeline = healthcheck recon account-server

pipeline = healthcheck recon backend_ratelimit account-server

[app:account-server]

use = egg:swift#account

@@ -128,6 +128,18 @@ use = egg:swift#healthcheck

use = egg:swift#recon

# recon_cache_path = /var/cache/swift

[filter:backend_ratelimit]

use = egg:swift#backend_ratelimit

# Set the maximum rate of requests per second per device per worker. Beyond

# this rate the server will return 529 responses and emit a 'backend.ratelimit'

# statsd metric without logging. The default value of zero causes no

# rate-limiting to be applied.

# requests_per_device_per_second = 0.0

#

# Set the number of seconds of unused rate-limiting allowance that can

# accumulate and be used to allow a subsequent burst of requests.

# requests_per_device_rate_buffer = 1.0

[account-replicator]

# You can override the default log routing for this app here (don't use set!):

# log_name = account-replicator

Add backend rate limiting middleware

14 etc/account-server.conf-sample Unescape Escape View File

14
etc/account-server.conf-sample

View File