proxy-logging: Add real-time transfer bytes counters

Code Issues Proposed changes

Currently we can get one proxy-logging transfer stat emission over the
duration of the upload/download. We want another stat coming out of
proxy-logging: something that gets emitted periodically as bytes are
actually sent/received so we can get reasonably accurate point-in-time
breakdowns of bandwidth usage.
Co-Authored-By: Alistair Coles <alistairncoles@gmail.com>
Co-Authored-By: Shreeya Deshpande <shreeyad@nvidia.com>
Change-Id: Ideecd0aa58ddf091c9f25f15022a9066088f532b
Signed-off-by: Yan Xiao <yanxiao@nvidia.com>

This commit is contained in:

Yan Xiao

2024年09月26日 09:35:35 -04:00

parent 9d7e7e27a5

commit dcd5a265f6

6 changed files with 1528 additions and 57 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

14
etc/proxy-server.conf-sample

View File

@@ -1128,7 +1128,19 @@ use = egg:swift#proxy_logging

# will be substituted with the appropriate values. For more information, see

# https://docs.openstack.org/swift/latest/logs.html

# log_msg_template = {client_ip} {remote_addr} {end_time.datetime} {method} {path} {protocol} {status_int} {referer} {user_agent} {auth_token} {bytes_recvd} {bytes_sent} {client_etag} {transaction_id} {headers} {request_time} {source} {log_info} {start_time} {end_time} {policy_index} {access_user_id}

# The proxy_logging middleware attempts to translate s3api request paths to

# swift paths. To do so it needs to know which, if any, storage domains are

# configured for virtual-hosted style requests. This option should be a

# comma-separated list of host names, exactly the same as that set for the

# s3api middleware.

# storage_domain =

#

# A float value in seconds for how often the proxy server should emit statsd

# real-time buffer transfer bytes counter metrics for WSGI input or output.

# Negative value for not emitting such metrics. 0 for always emitting such

# metrics on every input or output call. Default is -1.

# statsd_emit_buffer_xfer_bytes_seconds = -1

#

# Note: Put before both ratelimit and auth in the pipeline.

[filter:bulk]

use = egg:swift#bulk

proxy-logging: Add real-time transfer bytes counters

14 etc/proxy-server.conf-sample Unescape Escape View File

14
etc/proxy-server.conf-sample

View File