cc040a9c29361caa7cc02253e529c75b13fb2759
29 Commits
| Author | SHA1 | Message | Date | |
|---|---|---|---|---|
|
Victor Rodionov
|
7f534fac38 |
fix dict duplicated key
remove duplicated key from swift-bench bin; and also add .idea to gitignore Change-Id: I31360489716d03324b8d2bb1c51e282393069c13 |
||
|
Kun Huang
|
45dda5e356 |
Change logger name to module itself instead of root
Using root logger will make public module log failed by unknow keyword. Just change the logger name to module itself could dismiss this impact. And disable logger.propagate could prevent double outputing. Change-Id: I18696d124ebac9ca970d502558972e51de759097 Fixes: bug #1105133 |
||
|
Samuel Merritt
|
68479cc944 |
Add more command-line options to swift-bench.
These settings: 1. are already exposed via config file 2. were not exposed as command-line options, and 3. are things I wanted on the command line while benchmarking recently. I didn't include short options for --(get|put|delete)-concurrency since I couldn't think of good single-letter ones, and optparse won't take "-gc", "-pc", or "-dc". Change-Id: I0bd7c7ae2892244eed37b8c10c9357dc7e1190d3 |
||
|
Joe Arnold
|
5e4ca30281 |
Fixed swift-bench when using -b and a conf file
Change-Id: I72448cd8578b53a658f151354a26066772e4b9ec |
||
|
John Dickinson
|
8ac292595f |
changed TRUE_VALUES references to utils.config_true_value() call
cleaned up pep8 (v1.3.3) in all files this patch touches Change-Id: I30e8314dfdc23fb70ab83741a548db9905dfccff |
||
|
John Dickinson
|
af4b2851fc |
fix config parsing in swift-bench -x
This patch ensures that the command-line arg format (boolean) doesn't conflict with the conf file format (string) and the proper action is taken. Change-Id: I3284096e1a9478897e1c3246ab190b46d2590243 |
||
|
Darrell Bishop
|
ed3b12d05c |
Can run swift-bench across multiple cores/servers.
You run one or more swift-bench-client processes like this: $ swift-bench-client 127.0.0.1 20001 $ swift-bench-client 127.0.0.1 20002 Then you run swift-bench with a new option, --bench-clients (-b), which is specified once for each swift-bench-client: $ swift-bench -b 127.0.0.1:20001 -b 127.0.0.1:20002 You get log lines from each client (interleaved) along with a final report for all clients: 127.0.0.1:20002 swift-bench-server 2012年08月25日 22:44:06,148 INFO Auth version: 1.0 127.0.0.1:20001 swift-bench-server 2012年08月25日 22:44:06,148 INFO Auth version: 1.0 127.0.0.1:20001 swift-bench-server 2012年08月25日 22:44:12,249 INFO 83 PUTS [0 failures], 41.5/s 127.0.0.1:20002 swift-bench-server 2012年08月25日 22:44:14,430 INFO 74 PUTS [0 failures], 34.3/s ... 127.0.0.1:20002 swift-bench-server 2012年08月25日 22:45:18,942 INFO Auth version: 1.0 127.0.0.1:20002 swift-bench-server 2012年08月25日 22:45:20,946 INFO 238 DEL [2 failures], 118.9/s swift-bench 2012年08月25日 22:45:27,549 INFO 2000 PUTS **FINAL** [0 failures], 56.8/s swift-bench 2012年08月25日 22:45:27,550 INFO 30000 GETS **FINAL** [50 failures], 974.6/s swift-bench 2012年08月25日 22:45:27,550 INFO 2000 DEL **FINAL** [20 failures], 237.1/s The concurrency, PUT count, and GET count config settings are divided by the number of bench_clients. In other words, the same volume of work is attempted (vs. not specifying --bench-clients), but it can now span servers and CPU cores. Benchmark containers are created (if use_proxy = yes) and deleted (if delete = yes), with appropriate concurrency, in the initiating swift-bench process, not any of the swift-bench-client processes. Change-Id: Idbf31a23093244ab357a9bf77e6031257774f24a |
||
|
Darrell Bishop
|
9bda92d54a |
Misc. swift-bench improvements.
swift-bench now honors the environment variables, ST_AUTH, ST_USER, and ST_KEY like python-swiftclient does. Added --lower-object-size (or -l) command-line option which, if specified, will turn a specified --object-size into --upper-object-size. It will raise a ValueError if --object-size is not specified or is <= --lower-object-size. BenchController how handles SIGINT (KeyboardInterrupt) similarly to the swift command-line client: the first Ctrl-C will make it fast-track to completion (no new PUT or GET operations are started, but everything PUT is DELETE'ed). A second Ctrl-C will immediately exit. The behavior for SIGTERM is unchanged (a single SIGTERM will immediately terminate the process). Added a sample configuration file for swift-bench, with documenting comments. Change-Id: I6f394ad995300fc8af3d565d95c3b45559ee510a |
||
|
ning_zhang
|
aad7cdc364 |
To simulate the real workloads, the objects to be uploaded could be created in the random sizes, which are bounded (lower_object_size and upper_object_size) by the user inputs.
Change-Id: I64647c5d613a0794f0807886a4833cd5c31c0c5e |
||
|
Florian Hines
|
5f72a8db4a |
Fix Dispersion report and swift-bench on saio
We're still using saio:11000 in a few spots so a few things don't work out of the box on the saio. Fixes bug #1024561 Change-Id: I226de54c2785b0d0b681c8d0cc24260adbd3d663 |
||
|
François Charlier
|
ef3e556b72 |
swift-bench should be able to use auth version 2.0
Fixes Bug #1011727 Change-Id: I6681bd85a5ddb82a1059913ae90696e5994aa906 |
||
|
John Dickinson
|
1ecf5ebba1 |
updated copyright date for all files
Change-Id: Ifd909d3561c2647770a7e0caa3cd91acd1b4f298 |
||
|
David Goetz
|
51ce438f7f | changing /usr/bin/python to /usr/bin/env python | ||
|
Clay Gerrard
|
5d0bc6b9c7 |
logging refactor to support proxy access logs
New log level "notice" set to python log level 25 maps to syslog priority LOG_NOTICE. Used for some messages in the proxy server, but will be available to all apps using the LogAdapter returned from get_logger. Cleaned up some code in get_logger so that console logging works with log_routes and removed some unneeded bits. NamedFormatter functionality was split between LogAdapter (which now inherits from logging.LoggerAdapter) and TxnFormatter (which now is only responsible for adding the log records txn_id). The proxy server app now configures a separate logger for access line logging. By default it will use the same settings as the regular proxy logger. |
||
|
gholt
|
9dd1e2ae84 | Updates to remove _ usage that is not i18n related | ||
|
Clay Gerrard
|
ff0e62d914 | reworked tnx logging | ||
|
Clay Gerrard
|
6c1bf02a62 | pep8 fo' realz | ||
|
Anne Gentle
|
8823427161 | Changed copyright notices on py files and the single rst file with a copyright notice | ||
|
Clay Gerrard
|
68a9acf9b8 | pep8 | ||
|
Clay Gerrard
|
97028e0b9c |
fixed missing NamedLogger import in bin/swift-bench, refactored
LogAdapter.tnx_id so that it works with multiple calls to get_logger, fixed common.middleware.catch_errors to only call get_logger if it needs too, renamed x-cf-trans-id to x-swift-tnx-id |
||
|
gholt
|
57970bdeb5 | Cleaned up the bins; patched the broken test (when run standalone) | ||
|
Michael Barton
|
f432269013 | add gettext to all binaries | ||
|
Chuck Thier
|
43b3bf6095 | Updated swift-bench to put to several containers (20 by default) instead of just 1 | ||
|
Chuck Thier
|
84a163d736 | Somehow I missed the commit to print the whole help, not just usage | ||
|
Chuck Thier
|
18245c1adc | Updated to print usage by default if no args are passed, and added --saio to run with saio defaults | ||
|
Chuck Thier
|
d7d0bd4253 | added apache license to the new files | ||
|
Chuck Thier
|
117aef456d | Refactored swift-bench to reuse client.py and direct_client.py | ||
|
Chuck Thier
|
f71a85a05b | Missed a rename | ||
|
Chuck Thier
|
6cef24dcd7 | Initial checkin of benchmark code |