DVC Plot

Wed Dec 31 01:22:37 UTC 2025
dataset: mnist
project: example-get-started

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]  83.0487 (3.75)  83.0487 (3.75)  83.0487 (3.75)  0.0000 (1.0)  83.0487 (3.75)  0.0000 (1.0)  0;0 0.0120 (0.27)  1 1
test_add_copy-add[3.10.0]  84.6406 (3.82)  84.6406 (3.82)  84.6406 (3.82)  0.0000 (1.0)  84.6406 (3.82)  0.0000 (1.0)  0;0 0.0118 (0.26)  1 1
test_add_copy-add[3.53.2]  75.7958 (3.42)  75.7958 (3.42)  75.7958 (3.42)  0.0000 (1.0)  75.7958 (3.42)  0.0000 (1.0)  0;0 0.0132 (0.29)  1 1
test_add_copy-add[3.60.1]  22.1590 (1.0)  22.1590 (1.0)  22.1590 (1.0)  0.0000 (1.0)  22.1590 (1.0)  0.0000 (1.0)  0;0 0.0451 (1.0)  1 1
test_add_copy-add[main]  23.2669 (1.05)  23.2669 (1.05)  23.2669 (1.05)  0.0000 (1.0)  23.2669 (1.05)  0.0000 (1.0)  0;0 0.0430 (0.95)  1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]  27.1758 (6.62)  27.1758 (6.62)  27.1758 (6.62)  0.0000 (1.0)  27.1758 (6.62)  0.0000 (1.0)  0;0 0.0368 (0.15)  1 1
test_add_copy-add-noop[3.10.0]  27.7897 (6.77)  27.7897 (6.77)  27.7897 (6.77)  0.0000 (1.0)  27.7897 (6.77)  0.0000 (1.0)  0;0 0.0360 (0.15)  1 1
test_add_copy-add-noop[3.53.2]  26.3173 (6.41)  26.3173 (6.41)  26.3173 (6.41)  0.0000 (1.0)  26.3173 (6.41)  0.0000 (1.0)  0;0 0.0380 (0.16)  1 1
test_add_copy-add-noop[3.60.1]  4.1044 (1.0)  4.1044 (1.0)  4.1044 (1.0)  0.0000 (1.0)  4.1044 (1.0)  0.0000 (1.0)  0;0 0.2436 (1.0)  1 1
test_add_copy-add-noop[main]  4.3626 (1.06)  4.3626 (1.06)  4.3626 (1.06)  0.0000 (1.0)  4.3626 (1.06)  0.0000 (1.0)  0;0 0.2292 (0.94)  1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]  63.2143 (4.11)  63.2143 (4.11)  63.2143 (4.11)  0.0000 (1.0)  63.2143 (4.11)  0.0000 (1.0)  0;0 0.0158 (0.24)  1 1
test_add_hardlink-add[3.10.0]  64.4729 (4.19)  64.4729 (4.19)  64.4729 (4.19)  0.0000 (1.0)  64.4729 (4.19)  0.0000 (1.0)  0;0 0.0155 (0.24)  1 1
test_add_hardlink-add[3.53.2]  60.4442 (3.93)  60.4442 (3.93)  60.4442 (3.93)  0.0000 (1.0)  60.4442 (3.93)  0.0000 (1.0)  0;0 0.0165 (0.25)  1 1
test_add_hardlink-add[3.60.1]  15.3929 (1.0)  15.3929 (1.0)  15.3929 (1.0)  0.0000 (1.0)  15.3929 (1.0)  0.0000 (1.0)  0;0 0.0650 (1.0)  1 1
test_add_hardlink-add[main]  16.4102 (1.07)  16.4102 (1.07)  16.4102 (1.07)  0.0000 (1.0)  16.4102 (1.07)  0.0000 (1.0)  0;0 0.0609 (0.94)  1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]  31.8491 (7.74)  31.8491 (7.74)  31.8491 (7.74)  0.0000 (1.0)  31.8491 (7.74)  0.0000 (1.0)  0;0 0.0314 (0.13)  1 1
test_add_hardlink-add-noop[3.10.0]  32.4983 (7.90)  32.4983 (7.90)  32.4983 (7.90)  0.0000 (1.0)  32.4983 (7.90)  0.0000 (1.0)  0;0 0.0308 (0.13)  1 1
test_add_hardlink-add-noop[3.53.2]  31.1668 (7.58)  31.1668 (7.58)  31.1668 (7.58)  0.0000 (1.0)  31.1668 (7.58)  0.0000 (1.0)  0;0 0.0321 (0.13)  1 1
test_add_hardlink-add-noop[3.60.1]  4.1141 (1.0)  4.1141 (1.0)  4.1141 (1.0)  0.0000 (1.0)  4.1141 (1.0)  0.0000 (1.0)  0;0 0.2431 (1.0)  1 1
test_add_hardlink-add-noop[main]  4.2750 (1.04)  4.2750 (1.04)  4.2750 (1.04)  0.0000 (1.0)  4.2750 (1.04)  0.0000 (1.0)  0;0 0.2339 (0.96)  1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]  67.8642 (2.03)  67.8642 (2.03)  67.8642 (2.03)  0.0000 (1.0)  67.8642 (2.03)  0.0000 (1.0)  0;0 0.0147 (0.49)  1 1
test_add_symlink-add[3.10.0]  68.2241 (2.04)  68.2241 (2.04)  68.2241 (2.04)  0.0000 (1.0)  68.2241 (2.04)  0.0000 (1.0)  0;0 0.0147 (0.49)  1 1
test_add_symlink-add[3.53.2]  63.8131 (1.90)  63.8131 (1.90)  63.8131 (1.90)  0.0000 (1.0)  63.8131 (1.90)  0.0000 (1.0)  0;0 0.0157 (0.53)  1 1
test_add_symlink-add[3.60.1]  33.5058 (1.0)  33.5058 (1.0)  33.5058 (1.0)  0.0000 (1.0)  33.5058 (1.0)  0.0000 (1.0)  0;0 0.0298 (1.0)  1 1
test_add_symlink-add[main]  35.1746 (1.05)  35.1746 (1.05)  35.1746 (1.05)  0.0000 (1.0)  35.1746 (1.05)  0.0000 (1.0)  0;0 0.0284 (0.95)  1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]  44.8724 (8.57)  44.8724 (8.57)  44.8724 (8.57)  0.0000 (1.0)  44.8724 (8.57)  0.0000 (1.0)  0;0 0.0223 (0.12)  1 1
test_add_symlink-add-noop[3.10.0]  45.8614 (8.76)  45.8614 (8.76)  45.8614 (8.76)  0.0000 (1.0)  45.8614 (8.76)  0.0000 (1.0)  0;0 0.0218 (0.11)  1 1
test_add_symlink-add-noop[3.53.2]  44.6728 (8.53)  44.6728 (8.53)  44.6728 (8.53)  0.0000 (1.0)  44.6728 (8.53)  0.0000 (1.0)  0;0 0.0224 (0.12)  1 1
test_add_symlink-add-noop[3.60.1]  5.2358 (1.0)  5.2358 (1.0)  5.2358 (1.0)  0.0000 (1.0)  5.2358 (1.0)  0.0000 (1.0)  0;0 0.1910 (1.0)  1 1
test_add_symlink-add-noop[main]  5.4741 (1.05)  5.4741 (1.05)  5.4741 (1.05)  0.0000 (1.0)  5.4741 (1.05)  0.0000 (1.0)  0;0 0.1827 (0.96)  1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]  38.5263 (1.85)  38.5263 (1.85)  38.5263 (1.85)  0.0000 (1.0)  38.5263 (1.85)  0.0000 (1.0)  0;0 0.0260 (0.54)  1 1
test_checkout_copy-checkout[3.10.0]  56.4480 (2.71)  56.4480 (2.71)  56.4480 (2.71)  0.0000 (1.0)  56.4480 (2.71)  0.0000 (1.0)  0;0 0.0177 (0.37)  1 1
test_checkout_copy-checkout[3.53.2]  27.7597 (1.33)  27.7597 (1.33)  27.7597 (1.33)  0.0000 (1.0)  27.7597 (1.33)  0.0000 (1.0)  0;0 0.0360 (0.75)  1 1
test_checkout_copy-checkout[3.60.1]  20.8022 (1.0)  20.8022 (1.0)  20.8022 (1.0)  0.0000 (1.0)  20.8022 (1.0)  0.0000 (1.0)  0;0 0.0481 (1.0)  1 1
test_checkout_copy-checkout[main]  22.0298 (1.06)  22.0298 (1.06)  22.0298 (1.06)  0.0000 (1.0)  22.0298 (1.06)  0.0000 (1.0)  0;0 0.0454 (0.94)  1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]  5.3004 (1.63)  5.3004 (1.63)  5.3004 (1.63)  0.0000 (1.0)  5.3004 (1.63)  0.0000 (1.0)  0;0 0.1887 (0.61)  1 1
test_checkout_copy-checkout-noop[3.10.0]  5.5577 (1.71)  5.5577 (1.71)  5.5577 (1.71)  0.0000 (1.0)  5.5577 (1.71)  0.0000 (1.0)  0;0 0.1799 (0.59)  1 1
test_checkout_copy-checkout-noop[3.53.2]  5.4987 (1.69)  5.4987 (1.69)  5.4987 (1.69)  0.0000 (1.0)  5.4987 (1.69)  0.0000 (1.0)  0;0 0.1819 (0.59)  1 1
test_checkout_copy-checkout-noop[3.60.1]  3.2582 (1.0)  3.2582 (1.0)  3.2582 (1.0)  0.0000 (1.0)  3.2582 (1.0)  0.0000 (1.0)  0;0 0.3069 (1.0)  1 1
test_checkout_copy-checkout-noop[main]  3.5111 (1.08)  3.5111 (1.08)  3.5111 (1.08)  0.0000 (1.0)  3.5111 (1.08)  0.0000 (1.0)  0;0 0.2848 (0.93)  1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]  7.3492 (1.89)  7.3492 (1.89)  7.3492 (1.89)  0.0000 (1.0)  7.3492 (1.89)  0.0000 (1.0)  0;0 0.1361 (0.53)  1 1
test_checkout_copy-checkout-update[3.10.0]  6.2561 (1.61)  6.2561 (1.61)  6.2561 (1.61)  0.0000 (1.0)  6.2561 (1.61)  0.0000 (1.0)  0;0 0.1598 (0.62)  1 1
test_checkout_copy-checkout-update[3.53.2]  6.3153 (1.62)  6.3153 (1.62)  6.3153 (1.62)  0.0000 (1.0)  6.3153 (1.62)  0.0000 (1.0)  0;0 0.1583 (0.62)  1 1
test_checkout_copy-checkout-update[3.60.1]  3.8891 (1.0)  3.8891 (1.0)  3.8891 (1.0)  0.0000 (1.0)  3.8891 (1.0)  0.0000 (1.0)  0;0 0.2571 (1.0)  1 1
test_checkout_copy-checkout-update[main]  4.2883 (1.10)  4.2883 (1.10)  4.2883 (1.10)  0.0000 (1.0)  4.2883 (1.10)  0.0000 (1.0)  0;0 0.2332 (0.91)  1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]  22.0722 (2.89)  22.0722 (2.89)  22.0722 (2.89)  0.0000 (1.0)  22.0722 (2.89)  0.0000 (1.0)  0;0 0.0453 (0.35)  1 1
test_checkout_hardlink-checkout[3.10.0]  16.7301 (2.19)  16.7301 (2.19)  16.7301 (2.19)  0.0000 (1.0)  16.7301 (2.19)  0.0000 (1.0)  0;0 0.0598 (0.46)  1 1
test_checkout_hardlink-checkout[3.53.2]  15.3530 (2.01)  15.3530 (2.01)  15.3530 (2.01)  0.0000 (1.0)  15.3530 (2.01)  0.0000 (1.0)  0;0 0.0651 (0.50)  1 1
test_checkout_hardlink-checkout[3.60.1]  7.6294 (1.0)  7.6294 (1.0)  7.6294 (1.0)  0.0000 (1.0)  7.6294 (1.0)  0.0000 (1.0)  0;0 0.1311 (1.0)  1 1
test_checkout_hardlink-checkout[main]  8.7542 (1.15)  8.7542 (1.15)  8.7542 (1.15)  0.0000 (1.0)  8.7542 (1.15)  0.0000 (1.0)  0;0 0.1142 (0.87)  1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]  5.5630 (1.63)  5.5630 (1.63)  5.5630 (1.63)  0.0000 (1.0)  5.5630 (1.63)  0.0000 (1.0)  0;0 0.1798 (0.61)  1 1
test_checkout_hardlink-checkout-noop[3.10.0]  5.7248 (1.68)  5.7248 (1.68)  5.7248 (1.68)  0.0000 (1.0)  5.7248 (1.68)  0.0000 (1.0)  0;0 0.1747 (0.59)  1 1
test_checkout_hardlink-checkout-noop[3.53.2]  5.4996 (1.61)  5.4996 (1.61)  5.4996 (1.61)  0.0000 (1.0)  5.4996 (1.61)  0.0000 (1.0)  0;0 0.1818 (0.62)  1 1
test_checkout_hardlink-checkout-noop[3.60.1]  3.4059 (1.0)  3.4059 (1.0)  3.4059 (1.0)  0.0000 (1.0)  3.4059 (1.0)  0.0000 (1.0)  0;0 0.2936 (1.0)  1 1
test_checkout_hardlink-checkout-noop[main]  3.5454 (1.04)  3.5454 (1.04)  3.5454 (1.04)  0.0000 (1.0)  3.5454 (1.04)  0.0000 (1.0)  0;0 0.2821 (0.96)  1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]  7.8539 (1.96)  7.8539 (1.96)  7.8539 (1.96)  0.0000 (1.0)  7.8539 (1.96)  0.0000 (1.0)  0;0 0.1273 (0.51)  1 1
test_checkout_hardlink-checkout-update[3.10.0]  6.5100 (1.63)  6.5100 (1.63)  6.5100 (1.63)  0.0000 (1.0)  6.5100 (1.63)  0.0000 (1.0)  0;0 0.1536 (0.61)  1 1
test_checkout_hardlink-checkout-update[3.53.2]  6.3651 (1.59)  6.3651 (1.59)  6.3651 (1.59)  0.0000 (1.0)  6.3651 (1.59)  0.0000 (1.0)  0;0 0.1571 (0.63)  1 1
test_checkout_hardlink-checkout-update[3.60.1]  4.0029 (1.0)  4.0029 (1.0)  4.0029 (1.0)  0.0000 (1.0)  4.0029 (1.0)  0.0000 (1.0)  0;0 0.2498 (1.0)  1 1
test_checkout_hardlink-checkout-update[main]  4.4684 (1.12)  4.4684 (1.12)  4.4684 (1.12)  0.0000 (1.0)  4.4684 (1.12)  0.0000 (1.0)  0;0 0.2238 (0.90)  1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]  24.9758 (2.39)  24.9758 (2.39)  24.9758 (2.39)  0.0000 (1.0)  24.9758 (2.39)  0.0000 (1.0)  0;0 0.0400 (0.42)  1 1
test_checkout_symlink-checkout[3.10.0]  19.6919 (1.88)  19.6919 (1.88)  19.6919 (1.88)  0.0000 (1.0)  19.6919 (1.88)  0.0000 (1.0)  0;0 0.0508 (0.53)  1 1
test_checkout_symlink-checkout[3.53.2]  17.9666 (1.72)  17.9666 (1.72)  17.9666 (1.72)  0.0000 (1.0)  17.9666 (1.72)  0.0000 (1.0)  0;0 0.0557 (0.58)  1 1
test_checkout_symlink-checkout[3.60.1]  10.4611 (1.0)  10.4611 (1.0)  10.4611 (1.0)  0.0000 (1.0)  10.4611 (1.0)  0.0000 (1.0)  0;0 0.0956 (1.0)  1 1
test_checkout_symlink-checkout[main]  11.7294 (1.12)  11.7294 (1.12)  11.7294 (1.12)  0.0000 (1.0)  11.7294 (1.12)  0.0000 (1.0)  0;0 0.0853 (0.89)  1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]  6.4553 (1.52)  6.4553 (1.52)  6.4553 (1.52)  0.0000 (1.0)  6.4553 (1.52)  0.0000 (1.0)  0;0 0.1549 (0.66)  1 1
test_checkout_symlink-checkout-noop[3.10.0]  6.6705 (1.57)  6.6705 (1.57)  6.6705 (1.57)  0.0000 (1.0)  6.6705 (1.57)  0.0000 (1.0)  0;0 0.1499 (0.64)  1 1
test_checkout_symlink-checkout-noop[3.53.2]  6.6174 (1.56)  6.6174 (1.56)  6.6174 (1.56)  0.0000 (1.0)  6.6174 (1.56)  0.0000 (1.0)  0;0 0.1511 (0.64)  1 1
test_checkout_symlink-checkout-noop[3.60.1]  4.2422 (1.0)  4.2422 (1.0)  4.2422 (1.0)  0.0000 (1.0)  4.2422 (1.0)  0.0000 (1.0)  0;0 0.2357 (1.0)  1 1
test_checkout_symlink-checkout-noop[main]  4.4980 (1.06)  4.4980 (1.06)  4.4980 (1.06)  0.0000 (1.0)  4.4980 (1.06)  0.0000 (1.0)  0;0 0.2223 (0.94)  1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]  9.4530 (1.63)  9.4530 (1.63)  9.4530 (1.63)  0.0000 (1.0)  9.4530 (1.63)  0.0000 (1.0)  0;0 0.1058 (0.61)  1 1
test_checkout_symlink-checkout-update[3.10.0]  8.4762 (1.46)  8.4762 (1.46)  8.4762 (1.46)  0.0000 (1.0)  8.4762 (1.46)  0.0000 (1.0)  0;0 0.1180 (0.68)  1 1
test_checkout_symlink-checkout-update[3.53.2]  8.4929 (1.47)  8.4929 (1.47)  8.4929 (1.47)  0.0000 (1.0)  8.4929 (1.47)  0.0000 (1.0)  0;0 0.1177 (0.68)  1 1
test_checkout_symlink-checkout-update[3.60.1]  5.7934 (1.0)  5.7934 (1.0)  5.7934 (1.0)  0.0000 (1.0)  5.7934 (1.0)  0.0000 (1.0)  0;0 0.1726 (1.0)  1 1
test_checkout_symlink-checkout-update[main]  6.2083 (1.07)  6.2083 (1.07)  6.2083 (1.07)  0.0000 (1.0)  6.2083 (1.07)  0.0000 (1.0)  0;0 0.1611 (0.93)  1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]  4.0461 (1.76)  4.0461 (1.76)  4.0461 (1.76)  0.0000 (1.0)  4.0461 (1.76)  0.0000 (1.0)  0;0 0.2472 (0.57)  1 1
test_data_status-data-changed[3.10.0]  4.8620 (2.12)  4.8620 (2.12)  4.8620 (2.12)  0.0000 (1.0)  4.8620 (2.12)  0.0000 (1.0)  0;0 0.2057 (0.47)  1 1
test_data_status-data-changed[3.53.2]  4.7719 (2.08)  4.7719 (2.08)  4.7719 (2.08)  0.0000 (1.0)  4.7719 (2.08)  0.0000 (1.0)  0;0 0.2096 (0.48)  1 1
test_data_status-data-changed[3.60.1]  2.2972 (1.0)  2.2972 (1.0)  2.2972 (1.0)  0.0000 (1.0)  2.2972 (1.0)  0.0000 (1.0)  0;0 0.4353 (1.0)  1 1
test_data_status-data-changed[main]  2.5244 (1.10)  2.5244 (1.10)  2.5244 (1.10)  0.0000 (1.0)  2.5244 (1.10)  0.0000 (1.0)  0;0 0.3961 (0.91)  1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]  3.9957 (1.71)  3.9957 (1.71)  3.9957 (1.71)  0.0000 (1.0)  3.9957 (1.71)  0.0000 (1.0)  0;0 0.2503 (0.59)  1 1
test_data_status-data-changed-noop[3.10.0]  4.7643 (2.03)  4.7643 (2.03)  4.7643 (2.03)  0.0000 (1.0)  4.7643 (2.03)  0.0000 (1.0)  0;0 0.2099 (0.49)  1 1
test_data_status-data-changed-noop[3.53.2]  4.9360 (2.11)  4.9360 (2.11)  4.9360 (2.11)  0.0000 (1.0)  4.9360 (2.11)  0.0000 (1.0)  0;0 0.2026 (0.47)  1 1
test_data_status-data-changed-noop[3.60.1]  2.3435 (1.0)  2.3435 (1.0)  2.3435 (1.0)  0.0000 (1.0)  2.3435 (1.0)  0.0000 (1.0)  0;0 0.4267 (1.0)  1 1
test_data_status-data-changed-noop[main]  2.4811 (1.06)  2.4811 (1.06)  2.4811 (1.06)  0.0000 (1.0)  2.4811 (1.06)  0.0000 (1.0)  0;0 0.4030 (0.94)  1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]  17.9322 (3.85)  17.9322 (3.85)  17.9322 (3.85)  0.0000 (1.0)  17.9322 (3.85)  0.0000 (1.0)  0;0 0.0558 (0.26)  1 1
test_data_status-data-new[3.10.0]  18.8690 (4.05)  18.8690 (4.05)  18.8690 (4.05)  0.0000 (1.0)  18.8690 (4.05)  0.0000 (1.0)  0;0 0.0530 (0.25)  1 1
test_data_status-data-new[3.53.2]  18.4032 (3.95)  18.4032 (3.95)  18.4032 (3.95)  0.0000 (1.0)  18.4032 (3.95)  0.0000 (1.0)  0;0 0.0543 (0.25)  1 1
test_data_status-data-new[3.60.1]  4.6609 (1.0)  4.6609 (1.0)  4.6609 (1.0)  0.0000 (1.0)  4.6609 (1.0)  0.0000 (1.0)  0;0 0.2146 (1.0)  1 1
test_data_status-data-new[main]  5.0388 (1.08)  5.0388 (1.08)  5.0388 (1.08)  0.0000 (1.0)  5.0388 (1.08)  0.0000 (1.0)  0;0 0.1985 (0.92)  1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]  4.0932 (1.79)  4.0932 (1.79)  4.0932 (1.79)  0.0000 (1.0)  4.0932 (1.79)  0.0000 (1.0)  0;0 0.2443 (0.56)  1 1
test_data_status-data-noop[3.10.0]  4.8280 (2.11)  4.8280 (2.11)  4.8280 (2.11)  0.0000 (1.0)  4.8280 (2.11)  0.0000 (1.0)  0;0 0.2071 (0.47)  1 1
test_data_status-data-noop[3.53.2]  4.6247 (2.02)  4.6247 (2.02)  4.6247 (2.02)  0.0000 (1.0)  4.6247 (2.02)  0.0000 (1.0)  0;0 0.2162 (0.50)  1 1
test_data_status-data-noop[3.60.1]  2.2922 (1.0)  2.2922 (1.0)  2.2922 (1.0)  0.0000 (1.0)  2.2922 (1.0)  0.0000 (1.0)  0;0 0.4363 (1.0)  1 1
test_data_status-data-noop[main]  2.5239 (1.10)  2.5239 (1.10)  2.5239 (1.10)  0.0000 (1.0)  2.5239 (1.10)  0.0000 (1.0)  0;0 0.3962 (0.91)  1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]  6.7110 (1.32)  6.7110 (1.32)  6.7110 (1.32)  0.0000 (1.0)  6.7110 (1.32)  0.0000 (1.0)  0;0 0.1490 (0.76)  1 1
test_data_status_all_flags-data-changed[3.10.0]  7.4882 (1.47)  7.4882 (1.47)  7.4882 (1.47)  0.0000 (1.0)  7.4882 (1.47)  0.0000 (1.0)  0;0 0.1335 (0.68)  1 1
test_data_status_all_flags-data-changed[3.53.2]  7.5209 (1.48)  7.5209 (1.48)  7.5209 (1.48)  0.0000 (1.0)  7.5209 (1.48)  0.0000 (1.0)  0;0 0.1330 (0.68)  1 1
test_data_status_all_flags-data-changed[3.60.1]  5.0853 (1.0)  5.0853 (1.0)  5.0853 (1.0)  0.0000 (1.0)  5.0853 (1.0)  0.0000 (1.0)  0;0 0.1966 (1.0)  1 1
test_data_status_all_flags-data-changed[main]  5.3735 (1.06)  5.3735 (1.06)  5.3735 (1.06)  0.0000 (1.0)  5.3735 (1.06)  0.0000 (1.0)  0;0 0.1861 (0.95)  1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]  6.6990 (1.31)  6.6990 (1.31)  6.6990 (1.31)  0.0000 (1.0)  6.6990 (1.31)  0.0000 (1.0)  0;0 0.1493 (0.76)  1 1
test_data_status_all_flags-data-changed-noop[3.10.0]  7.5553 (1.48)  7.5553 (1.48)  7.5553 (1.48)  0.0000 (1.0)  7.5553 (1.48)  0.0000 (1.0)  0;0 0.1324 (0.68)  1 1
test_data_status_all_flags-data-changed-noop[3.53.2]  7.3687 (1.44)  7.3687 (1.44)  7.3687 (1.44)  0.0000 (1.0)  7.3687 (1.44)  0.0000 (1.0)  0;0 0.1357 (0.69)  1 1
test_data_status_all_flags-data-changed-noop[3.60.1]  5.1099 (1.0)  5.1099 (1.0)  5.1099 (1.0)  0.0000 (1.0)  5.1099 (1.0)  0.0000 (1.0)  0;0 0.1957 (1.0)  1 1
test_data_status_all_flags-data-changed-noop[main]  5.3761 (1.05)  5.3761 (1.05)  5.3761 (1.05)  0.0000 (1.0)  5.3761 (1.05)  0.0000 (1.0)  0;0 0.1860 (0.95)  1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]  20.7585 (2.77)  20.7585 (2.77)  20.7585 (2.77)  0.0000 (1.0)  20.7585 (2.77)  0.0000 (1.0)  0;0 0.0482 (0.36)  1 1
test_data_status_all_flags-data-new[3.10.0]  21.4814 (2.87)  21.4814 (2.87)  21.4814 (2.87)  0.0000 (1.0)  21.4814 (2.87)  0.0000 (1.0)  0;0 0.0466 (0.35)  1 1
test_data_status_all_flags-data-new[3.53.2]  21.3484 (2.85)  21.3484 (2.85)  21.3484 (2.85)  0.0000 (1.0)  21.3484 (2.85)  0.0000 (1.0)  0;0 0.0468 (0.35)  1 1
test_data_status_all_flags-data-new[3.60.1]  7.4969 (1.0)  7.4969 (1.0)  7.4969 (1.0)  0.0000 (1.0)  7.4969 (1.0)  0.0000 (1.0)  0;0 0.1334 (1.0)  1 1
test_data_status_all_flags-data-new[main]  7.7428 (1.03)  7.7428 (1.03)  7.7428 (1.03)  0.0000 (1.0)  7.7428 (1.03)  0.0000 (1.0)  0;0 0.1292 (0.97)  1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]  6.2416 (1.40)  6.2416 (1.40)  6.2416 (1.40)  0.0000 (1.0)  6.2416 (1.40)  0.0000 (1.0)  0;0 0.1602 (0.72)  1 1
test_data_status_all_flags-data-noop[3.10.0]  6.8960 (1.54)  6.8960 (1.54)  6.8960 (1.54)  0.0000 (1.0)  6.8960 (1.54)  0.0000 (1.0)  0;0 0.1450 (0.65)  1 1
test_data_status_all_flags-data-noop[3.53.2]  6.9833 (1.56)  6.9833 (1.56)  6.9833 (1.56)  0.0000 (1.0)  6.9833 (1.56)  0.0000 (1.0)  0;0 0.1432 (0.64)  1 1
test_data_status_all_flags-data-noop[3.60.1]  4.4713 (1.0)  4.4713 (1.0)  4.4713 (1.0)  0.0000 (1.0)  4.4713 (1.0)  0.0000 (1.0)  0;0 0.2236 (1.0)  1 1
test_data_status_all_flags-data-noop[main]  4.7223 (1.06)  4.7223 (1.06)  4.7223 (1.06)  0.0000 (1.0)  4.7223 (1.06)  0.0000 (1.0)  0;0 0.2118 (0.95)  1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]  18.0920 (2.73)  18.0920 (2.73)  18.0920 (2.73)  0.0000 (1.0)  18.0920 (2.73)  0.0000 (1.0)  0;0 0.0553 (0.37)  1 1
test_diff-diff[3.10.0]  18.9526 (2.86)  18.9526 (2.86)  18.9526 (2.86)  0.0000 (1.0)  18.9526 (2.86)  0.0000 (1.0)  0;0 0.0528 (0.35)  1 1
test_diff-diff[3.53.2]  19.0461 (2.87)  19.0461 (2.87)  19.0461 (2.87)  0.0000 (1.0)  19.0461 (2.87)  0.0000 (1.0)  0;0 0.0525 (0.35)  1 1
test_diff-diff[3.60.1]  6.6320 (1.0)  6.6320 (1.0)  6.6320 (1.0)  0.0000 (1.0)  6.6320 (1.0)  0.0000 (1.0)  0;0 0.1508 (1.0)  1 1
test_diff-diff[main]  7.5595 (1.14)  7.5595 (1.14)  7.5595 (1.14)  0.0000 (1.0)  7.5595 (1.14)  0.0000 (1.0)  0;0 0.1323 (0.88)  1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]  5.8609 (1.77)  5.8609 (1.77)  5.8609 (1.77)  0.0000 (1.0)  5.8609 (1.77)  0.0000 (1.0)  0;0 0.1706 (0.57)  1 1
test_diff-diff-changed[3.10.0]  6.7070 (2.03)  6.7070 (2.03)  6.7070 (2.03)  0.0000 (1.0)  6.7070 (2.03)  0.0000 (1.0)  0;0 0.1491 (0.49)  1 1
test_diff-diff-changed[3.53.2]  5.6177 (1.70)  5.6177 (1.70)  5.6177 (1.70)  0.0000 (1.0)  5.6177 (1.70)  0.0000 (1.0)  0;0 0.1780 (0.59)  1 1
test_diff-diff-changed[3.60.1]  3.3121 (1.0)  3.3121 (1.0)  3.3121 (1.0)  0.0000 (1.0)  3.3121 (1.0)  0.0000 (1.0)  0;0 0.3019 (1.0)  1 1
test_diff-diff-changed[main]  4.0954 (1.24)  4.0954 (1.24)  4.0954 (1.24)  0.0000 (1.0)  4.0954 (1.24)  0.0000 (1.0)  0;0 0.2442 (0.81)  1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]  5.1311 (1.54)  5.1311 (1.54)  5.1311 (1.54)  0.0000 (1.0)  5.1311 (1.54)  0.0000 (1.0)  0;0 0.1949 (0.65)  1 1
test_diff-diff-changed-noop[3.10.0]  5.7222 (1.72)  5.7222 (1.72)  5.7222 (1.72)  0.0000 (1.0)  5.7222 (1.72)  0.0000 (1.0)  0;0 0.1748 (0.58)  1 1
test_diff-diff-changed-noop[3.53.2]  5.6385 (1.69)  5.6385 (1.69)  5.6385 (1.69)  0.0000 (1.0)  5.6385 (1.69)  0.0000 (1.0)  0;0 0.1774 (0.59)  1 1
test_diff-diff-changed-noop[3.60.1]  3.3289 (1.0)  3.3289 (1.0)  3.3289 (1.0)  0.0000 (1.0)  3.3289 (1.0)  0.0000 (1.0)  0;0 0.3004 (1.0)  1 1
test_diff-diff-changed-noop[main]  4.1199 (1.24)  4.1199 (1.24)  4.1199 (1.24)  0.0000 (1.0)  4.1199 (1.24)  0.0000 (1.0)  0;0 0.2427 (0.81)  1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]  4.0362 (1.20)  4.0362 (1.20)  4.0362 (1.20)  0.0000 (1.0)  4.0362 (1.20)  0.0000 (1.0)  0;0 0.2478 (0.83)  1 1
test_diff-diff-noop[3.10.0]  5.0898 (1.52)  5.0898 (1.52)  5.0898 (1.52)  0.0000 (1.0)  5.0898 (1.52)  0.0000 (1.0)  0;0 0.1965 (0.66)  1 1
test_diff-diff-noop[3.53.2]  5.6095 (1.67)  5.6095 (1.67)  5.6095 (1.67)  0.0000 (1.0)  5.6095 (1.67)  0.0000 (1.0)  0;0 0.1783 (0.60)  1 1
test_diff-diff-noop[3.60.1]  3.3580 (1.0)  3.3580 (1.0)  3.3580 (1.0)  0.0000 (1.0)  3.3580 (1.0)  0.0000 (1.0)  0;0 0.2978 (1.0)  1 1
test_diff-diff-noop[main]  4.1268 (1.23)  4.1268 (1.23)  4.1268 (1.23)  0.0000 (1.0)  4.1268 (1.23)  0.0000 (1.0)  0;0 0.2423 (0.81)  1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]  1.0510 (1.0)  1.0510 (1.0)  1.0510 (1.0)  0.0000 (1.0)  1.0510 (1.0)  0.0000 (1.0)  0;0 0.9514 (1.0)  1 1
test_exp_show-exp[3.10.0]  4.6183 (4.39)  4.6183 (4.39)  4.6183 (4.39)  0.0000 (1.0)  4.6183 (4.39)  0.0000 (1.0)  0;0 0.2165 (0.23)  1 1
test_exp_show-exp[3.53.2]  2.7388 (2.61)  2.7388 (2.61)  2.7388 (2.61)  0.0000 (1.0)  2.7388 (2.61)  0.0000 (1.0)  0;0 0.3651 (0.38)  1 1
test_exp_show-exp[3.60.1]  2.6355 (2.51)  2.6355 (2.51)  2.6355 (2.51)  0.0000 (1.0)  2.6355 (2.51)  0.0000 (1.0)  0;0 0.3794 (0.40)  1 1
test_exp_show-exp[main]  6.6731 (6.35)  6.6731 (6.35)  6.6731 (6.35)  0.0000 (1.0)  6.6731 (6.35)  0.0000 (1.0)  0;0 0.1499 (0.16)  1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]  49.7695 (3.15)  49.7695 (3.15)  49.7695 (3.15)  0.0000 (1.0)  49.7695 (3.15)  0.0000 (1.0)  0;0 0.0201 (0.32)  1 1
test_fetch-fetch[3.10.0]  53.9234 (3.41)  53.9234 (3.41)  53.9234 (3.41)  0.0000 (1.0)  53.9234 (3.41)  0.0000 (1.0)  0;0 0.0185 (0.29)  1 1
test_fetch-fetch[3.53.2]  23.7480 (1.50)  23.7480 (1.50)  23.7480 (1.50)  0.0000 (1.0)  23.7480 (1.50)  0.0000 (1.0)  0;0 0.0421 (0.66)  1 1
test_fetch-fetch[3.60.1]  15.7906 (1.0)  15.7906 (1.0)  15.7906 (1.0)  0.0000 (1.0)  15.7906 (1.0)  0.0000 (1.0)  0;0 0.0633 (1.0)  1 1
test_fetch-fetch[main]  16.1300 (1.02)  16.1300 (1.02)  16.1300 (1.02)  0.0000 (1.0)  16.1300 (1.02)  0.0000 (1.0)  0;0 0.0620 (0.98)  1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]  2.0712 (1.00)  2.0712 (1.00)  2.0712 (1.00)  0.0000 (1.0)  2.0712 (1.00)  0.0000 (1.0)  0;0 0.4828 (1.00)  1 1
test_gc-gc[3.10.0]  2.1476 (1.04)  2.1476 (1.04)  2.1476 (1.04)  0.0000 (1.0)  2.1476 (1.04)  0.0000 (1.0)  0;0 0.4656 (0.96)  1 1
test_gc-gc[3.53.2]  2.1067 (1.02)  2.1067 (1.02)  2.1067 (1.02)  0.0000 (1.0)  2.1067 (1.02)  0.0000 (1.0)  0;0 0.4747 (0.98)  1 1
test_gc-gc[3.60.1]  2.0627 (1.0)  2.0627 (1.0)  2.0627 (1.0)  0.0000 (1.0)  2.0627 (1.0)  0.0000 (1.0)  0;0 0.4848 (1.0)  1 1
test_gc-gc[main]  2.2926 (1.11)  2.2926 (1.11)  2.2926 (1.11)  0.0000 (1.0)  2.2926 (1.11)  0.0000 (1.0)  0;0 0.4362 (0.90)  1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]  130.0086 (2.64)  130.0086 (2.64)  130.0086 (2.64)  0.0000 (1.0)  130.0086 (2.64)  0.0000 (1.0)  0;0 0.0077 (0.38)  1 1
test_get-get[3.10.0]  157.1536 (3.19)  157.1536 (3.19)  157.1536 (3.19)  0.0000 (1.0)  157.1536 (3.19)  0.0000 (1.0)  0;0 0.0064 (0.31)  1 1
test_get-get[3.53.2]  140.3398 (2.85)  140.3398 (2.85)  140.3398 (2.85)  0.0000 (1.0)  140.3398 (2.85)  0.0000 (1.0)  0;0 0.0071 (0.35)  1 1
test_get-get[3.60.1]  49.5196 (1.01)  49.5196 (1.01)  49.5196 (1.01)  0.0000 (1.0)  49.5196 (1.01)  0.0000 (1.0)  0;0 0.0202 (0.99)  1 1
test_get-get[main]  49.2663 (1.0)  49.2663 (1.0)  49.2663 (1.0)  0.0000 (1.0)  49.2663 (1.0)  0.0000 (1.0)  0;0 0.0203 (1.0)  1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]  40.9064 (2.47)  40.9064 (2.47)  40.9064 (2.47)  0.0000 (1.0)  40.9064 (2.47)  0.0000 (1.0)  0;0 0.0244 (0.40)  1 1
test_get_url-get-url[3.10.0]  43.4292 (2.62)  43.4292 (2.62)  43.4292 (2.62)  0.0000 (1.0)  43.4292 (2.62)  0.0000 (1.0)  0;0 0.0230 (0.38)  1 1
test_get_url-get-url[3.53.2]  16.6397 (1.01)  16.6397 (1.01)  16.6397 (1.01)  0.0000 (1.0)  16.6397 (1.01)  0.0000 (1.0)  0;0 0.0601 (0.99)  1 1
test_get_url-get-url[3.60.1]  16.7978 (1.02)  16.7978 (1.02)  16.7978 (1.02)  0.0000 (1.0)  16.7978 (1.02)  0.0000 (1.0)  0;0 0.0595 (0.98)  1 1
test_get_url-get-url[main]  16.5454 (1.0)  16.5454 (1.0)  16.5454 (1.0)  0.0000 (1.0)  16.5454 (1.0)  0.0000 (1.0)  0;0 0.0604 (1.0)  1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]  147.4324 (1.06)  161.4450 (1.07)  154.7494 (1.06)  3.2651 (1.67)  155.3425 (1.07)  4.4559 (1.66)  35;0 6.4621 (0.94)  100 1
test_help---help[3.10.0]  142.2254 (1.02)  151.2445 (1.0)  146.3360 (1.01)  1.9593 (1.0)  146.3846 (1.01)  2.6842 (1.0)  34;0 6.8336 (0.99)  100 1
test_help---help[3.53.2]  146.1730 (1.05)  164.1454 (1.09)  151.6792 (1.04)  3.9966 (2.04)  150.8553 (1.04)  5.2816 (1.97)  29;1 6.5929 (0.96)  100 1
test_help---help[3.60.1]  153.5163 (1.10)  180.8136 (1.20)  159.0862 (1.09)  4.7636 (2.43)  158.1678 (1.09)  3.3340 (1.24)  9;6 6.2859 (0.91)  100 1
test_help---help[main]  138.9385 (1.0)  175.1692 (1.16)  145.5025 (1.0)  4.5634 (2.33)  145.5686 (1.0)  5.9018 (2.20)  24;1 6.8727 (1.0)  100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]  215.9271 (2.85)  215.9271 (2.85)  215.9271 (2.85)  0.0000 (1.0)  215.9271 (2.85)  0.0000 (1.0)  0;0 0.0046 (0.35)  1 1
test_import-import[3.10.0]  247.0220 (3.26)  247.0220 (3.26)  247.0220 (3.26)  0.0000 (1.0)  247.0220 (3.26)  0.0000 (1.0)  0;0 0.0040 (0.31)  1 1
test_import-import[3.60.1]  75.8181 (1.0)  75.8181 (1.0)  75.8181 (1.0)  0.0000 (1.0)  75.8181 (1.0)  0.0000 (1.0)  0;0 0.0132 (1.0)  1 1
test_import-import[main]  76.6097 (1.01)  76.6097 (1.01)  76.6097 (1.01)  0.0000 (1.0)  76.6097 (1.01)  0.0000 (1.0)  0;0 0.0131 (0.99)  1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]  149.3076 (3.32)  149.3076 (3.32)  149.3076 (3.32)  0.0000 (1.0)  149.3076 (3.32)  0.0000 (1.0)  0;0 0.0067 (0.30)  1 1
test_import_url-import-url[3.10.0]  151.5171 (3.37)  151.5171 (3.37)  151.5171 (3.37)  0.0000 (1.0)  151.5171 (3.37)  0.0000 (1.0)  0;0 0.0066 (0.30)  1 1
test_import_url-import-url[3.53.2]  116.1272 (2.59)  116.1272 (2.59)  116.1272 (2.59)  0.0000 (1.0)  116.1272 (2.59)  0.0000 (1.0)  0;0 0.0086 (0.39)  1 1
test_import_url-import-url[3.60.1]  44.9125 (1.0)  44.9125 (1.0)  44.9125 (1.0)  0.0000 (1.0)  44.9125 (1.0)  0.0000 (1.0)  0;0 0.0223 (1.0)  1 1
test_import_url-import-url[main]  46.3506 (1.03)  46.3506 (1.03)  46.3506 (1.03)  0.0000 (1.0)  46.3506 (1.03)  0.0000 (1.0)  0;0 0.0216 (0.97)  1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]  425.5686 (1.05)  493.8866 (1.06)  442.3603 (1.05)  14.6444 (1.10)  437.8499 (1.06)  13.1282 (1.30)  18;11 2.2606 (0.95)  100 1
test_init-init[3.10.0]  428.9832 (1.06)  504.3036 (1.08)  456.0265 (1.09)  16.9736 (1.28)  457.5120 (1.10)  27.2395 (2.71)  33;0 2.1929 (0.92)  100 1
test_init-init[3.53.2]  405.6159 (1.00)  476.0640 (1.02)  419.4447 (1.0)  13.3117 (1.0)  415.0546 (1.00)  10.0690 (1.0)  17;14 2.3841 (1.0)  100 1
test_init-init[3.60.1]  405.3739 (1.0)  465.0375 (1.0)  422.6095 (1.01)  16.8788 (1.27)  414.3124 (1.0)  20.7704 (2.06)  22;1 2.3663 (0.99)  100 1
test_init-init[main]  435.3004 (1.07)  517.6691 (1.11)  451.9447 (1.08)  18.3338 (1.38)  443.1855 (1.07)  17.3423 (1.72)  17;10 2.2127 (0.93)  100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]  664.0788 (1.05)  664.0788 (1.05)  664.0788 (1.05)  0.0000 (1.0)  664.0788 (1.05)  0.0000 (1.0)  0;0 1.5058 (0.95)  1 1
test_list-list[3.10.0]  787.6150 (1.24)  787.6150 (1.24)  787.6150 (1.24)  0.0000 (1.0)  787.6150 (1.24)  0.0000 (1.0)  0;0 1.2697 (0.80)  1 1
test_list-list[3.53.2]  654.1054 (1.03)  654.1054 (1.03)  654.1054 (1.03)  0.0000 (1.0)  654.1054 (1.03)  0.0000 (1.0)  0;0 1.5288 (0.97)  1 1
test_list-list[3.60.1]  690.1311 (1.09)  690.1311 (1.09)  690.1311 (1.09)  0.0000 (1.0)  690.1311 (1.09)  0.0000 (1.0)  0;0 1.4490 (0.92)  1 1
test_list-list[main]  633.6315 (1.0)  633.6315 (1.0)  633.6315 (1.0)  0.0000 (1.0)  633.6315 (1.0)  0.0000 (1.0)  0;0 1.5782 (1.0)  1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]  474.5744 (1.06)  474.5744 (1.06)  474.5744 (1.06)  0.0000 (1.0)  474.5744 (1.06)  0.0000 (1.0)  0;0 2.1072 (0.94)  1 1
test_list-list-dvc-only[3.10.0]  484.1221 (1.08)  484.1221 (1.08)  484.1221 (1.08)  0.0000 (1.0)  484.1221 (1.08)  0.0000 (1.0)  0;0 2.0656 (0.93)  1 1
test_list-list-dvc-only[3.53.2]  448.2652 (1.0)  448.2652 (1.0)  448.2652 (1.0)  0.0000 (1.0)  448.2652 (1.0)  0.0000 (1.0)  0;0 2.2308 (1.0)  1 1
test_list-list-dvc-only[3.60.1]  456.1281 (1.02)  456.1281 (1.02)  456.1281 (1.02)  0.0000 (1.0)  456.1281 (1.02)  0.0000 (1.0)  0;0 2.1924 (0.98)  1 1
test_list-list-dvc-only[main]  458.0185 (1.02)  458.0185 (1.02)  458.0185 (1.02)  0.0000 (1.0)  458.0185 (1.02)  0.0000 (1.0)  0;0 2.1833 (0.98)  1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]  2.5300 (1.0)  2.5300 (1.0)  2.5300 (1.0)  0.0000 (1.0)  2.5300 (1.0)  0.0000 (1.0)  0;0 0.3953 (1.0)  1 1
test_list-list-recursive[3.10.0]  2.7004 (1.07)  2.7004 (1.07)  2.7004 (1.07)  0.0000 (1.0)  2.7004 (1.07)  0.0000 (1.0)  0;0 0.3703 (0.94)  1 1
test_list-list-recursive[3.53.2]  2.8466 (1.13)  2.8466 (1.13)  2.8466 (1.13)  0.0000 (1.0)  2.8466 (1.13)  0.0000 (1.0)  0;0 0.3513 (0.89)  1 1
test_list-list-recursive[3.60.1]  2.9150 (1.15)  2.9150 (1.15)  2.9150 (1.15)  0.0000 (1.0)  2.9150 (1.15)  0.0000 (1.0)  0;0 0.3430 (0.87)  1 1
test_list-list-recursive[main]  2.8815 (1.14)  2.8815 (1.14)  2.8815 (1.14)  0.0000 (1.0)  2.8815 (1.14)  0.0000 (1.0)  0;0 0.3470 (0.88)  1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]  490.5852 (1.13)  490.5852 (1.13)  490.5852 (1.13)  0.0000 (1.0)  490.5852 (1.13)  0.0000 (1.0)  0;0 2.0384 (0.89)  1 1
test_list-list-shallow[3.10.0]  469.1494 (1.08)  469.1494 (1.08)  469.1494 (1.08)  0.0000 (1.0)  469.1494 (1.08)  0.0000 (1.0)  0;0 2.1315 (0.93)  1 1
test_list-list-shallow[3.53.2]  436.0109 (1.0)  436.0109 (1.0)  436.0109 (1.0)  0.0000 (1.0)  436.0109 (1.0)  0.0000 (1.0)  0;0 2.2935 (1.0)  1 1
test_list-list-shallow[3.60.1]  460.2380 (1.06)  460.2380 (1.06)  460.2380 (1.06)  0.0000 (1.0)  460.2380 (1.06)  0.0000 (1.0)  0;0 2.1728 (0.95)  1 1
test_list-list-shallow[main]  440.2603 (1.01)  440.2603 (1.01)  440.2603 (1.01)  0.0000 (1.0)  440.2603 (1.01)  0.0000 (1.0)  0;0 2.2714 (0.99)  1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]  70.0477 (3.67)  70.0477 (3.67)  70.0477 (3.67)  0.0000 (1.0)  70.0477 (3.67)  0.0000 (1.0)  0;0 0.0143 (0.27)  1 1
test_partial_add-add[3.10.0]  71.1063 (3.73)  71.1063 (3.73)  71.1063 (3.73)  0.0000 (1.0)  71.1063 (3.73)  0.0000 (1.0)  0;0 0.0141 (0.27)  1 1
test_partial_add-add[3.53.2]  63.8535 (3.35)  63.8535 (3.35)  63.8535 (3.35)  0.0000 (1.0)  63.8535 (3.35)  0.0000 (1.0)  0;0 0.0157 (0.30)  1 1
test_partial_add-add[3.60.1]  19.0711 (1.0)  19.0711 (1.0)  19.0711 (1.0)  0.0000 (1.0)  19.0711 (1.0)  0.0000 (1.0)  0;0 0.0524 (1.0)  1 1
test_partial_add-add[main]  20.2481 (1.06)  20.2481 (1.06)  20.2481 (1.06)  0.0000 (1.0)  20.2481 (1.06)  0.0000 (1.0)  0;0 0.0494 (0.94)  1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]  58.7027 (7.84)  58.7027 (7.84)  58.7027 (7.84)  0.0000 (1.0)  58.7027 (7.84)  0.0000 (1.0)  0;0 0.0170 (0.13)  1 1
test_partial_add-add-partial[3.10.0]  59.5484 (7.96)  59.5484 (7.96)  59.5484 (7.96)  0.0000 (1.0)  59.5484 (7.96)  0.0000 (1.0)  0;0 0.0168 (0.13)  1 1
test_partial_add-add-partial[3.53.2]  53.9971 (7.21)  53.9971 (7.21)  53.9971 (7.21)  0.0000 (1.0)  53.9971 (7.21)  0.0000 (1.0)  0;0 0.0185 (0.14)  1 1
test_partial_add-add-partial[3.60.1]  7.4842 (1.0)  7.4842 (1.0)  7.4842 (1.0)  0.0000 (1.0)  7.4842 (1.0)  0.0000 (1.0)  0;0 0.1336 (1.0)  1 1
test_partial_add-add-partial[main]  7.5384 (1.01)  7.5384 (1.01)  7.5384 (1.01)  0.0000 (1.0)  7.5384 (1.01)  0.0000 (1.0)  0;0 0.1327 (0.99)  1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]  4.4425 (1.0)  4.4425 (1.0)  4.4425 (1.0)  0.0000 (1.0)  4.4425 (1.0)  0.0000 (1.0)  0;0 0.2251 (1.0)  1 1
test_partial_add-gc-cloud-noop[3.10.0]  5.8434 (1.32)  5.8434 (1.32)  5.8434 (1.32)  0.0000 (1.0)  5.8434 (1.32)  0.0000 (1.0)  0;0 0.1711 (0.76)  1 1
test_partial_add-gc-cloud-noop[3.53.2]  6.7757 (1.53)  6.7757 (1.53)  6.7757 (1.53)  0.0000 (1.0)  6.7757 (1.53)  0.0000 (1.0)  0;0 0.1476 (0.66)  1 1
test_partial_add-gc-cloud-noop[3.60.1]  6.6811 (1.50)  6.6811 (1.50)  6.6811 (1.50)  0.0000 (1.0)  6.6811 (1.50)  0.0000 (1.0)  0;0 0.1497 (0.66)  1 1
test_partial_add-gc-cloud-noop[main]  6.7747 (1.52)  6.7747 (1.52)  6.7747 (1.52)  0.0000 (1.0)  6.7747 (1.52)  0.0000 (1.0)  0;0 0.1476 (0.66)  1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]  2.4261 (1.0)  2.4261 (1.0)  2.4261 (1.0)  0.0000 (1.0)  2.4261 (1.0)  0.0000 (1.0)  0;0 0.4122 (1.0)  1 1
test_partial_add-gc-noop[3.10.0]  3.7109 (1.53)  3.7109 (1.53)  3.7109 (1.53)  0.0000 (1.0)  3.7109 (1.53)  0.0000 (1.0)  0;0 0.2695 (0.65)  1 1
test_partial_add-gc-noop[3.53.2]  3.7193 (1.53)  3.7193 (1.53)  3.7193 (1.53)  0.0000 (1.0)  3.7193 (1.53)  0.0000 (1.0)  0;0 0.2689 (0.65)  1 1
test_partial_add-gc-noop[3.60.1]  3.7814 (1.56)  3.7814 (1.56)  3.7814 (1.56)  0.0000 (1.0)  3.7814 (1.56)  0.0000 (1.0)  0;0 0.2645 (0.64)  1 1
test_partial_add-gc-noop[main]  3.8544 (1.59)  3.8544 (1.59)  3.8544 (1.59)  0.0000 (1.0)  3.8544 (1.59)  0.0000 (1.0)  0;0 0.2594 (0.63)  1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]  40.8779 (2.16)  40.8779 (2.16)  40.8779 (2.16)  0.0000 (1.0)  40.8779 (2.16)  0.0000 (1.0)  0;0 0.0245 (0.46)  1 1
test_partial_add-push[3.10.0]  35.8287 (1.89)  35.8287 (1.89)  35.8287 (1.89)  0.0000 (1.0)  35.8287 (1.89)  0.0000 (1.0)  0;0 0.0279 (0.53)  1 1
test_partial_add-push[3.53.2]  19.2181 (1.01)  19.2181 (1.01)  19.2181 (1.01)  0.0000 (1.0)  19.2181 (1.01)  0.0000 (1.0)  0;0 0.0520 (0.99)  1 1
test_partial_add-push[3.60.1]  18.9871 (1.00)  18.9871 (1.00)  18.9871 (1.00)  0.0000 (1.0)  18.9871 (1.00)  0.0000 (1.0)  0;0 0.0527 (1.00)  1 1
test_partial_add-push[main]  18.9358 (1.0)  18.9358 (1.0)  18.9358 (1.0)  0.0000 (1.0)  18.9358 (1.0)  0.0000 (1.0)  0;0 0.0528 (1.0)  1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]  10.7282 (1.08)  10.7282 (1.08)  10.7282 (1.08)  0.0000 (1.0)  10.7282 (1.08)  0.0000 (1.0)  0;0 0.0932 (0.93)  1 1
test_partial_add-push-partial[3.10.0]  9.9650 (1.0)  9.9650 (1.0)  9.9650 (1.0)  0.0000 (1.0)  9.9650 (1.0)  0.0000 (1.0)  0;0 0.1004 (1.0)  1 1
test_partial_add-push-partial[3.53.2]  10.3443 (1.04)  10.3443 (1.04)  10.3443 (1.04)  0.0000 (1.0)  10.3443 (1.04)  0.0000 (1.0)  0;0 0.0967 (0.96)  1 1
test_partial_add-push-partial[3.60.1]  10.1464 (1.02)  10.1464 (1.02)  10.1464 (1.02)  0.0000 (1.0)  10.1464 (1.02)  0.0000 (1.0)  0;0 0.0986 (0.98)  1 1
test_partial_add-push-partial[main]  10.3010 (1.03)  10.3010 (1.03)  10.3010 (1.03)  0.0000 (1.0)  10.3010 (1.03)  0.0000 (1.0)  0;0 0.0971 (0.97)  1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]  79.5261 (3.62)  79.5261 (3.62)  79.5261 (3.62)  0.0000 (1.0)  79.5261 (3.62)  0.0000 (1.0)  0;0 0.0126 (0.28)  1 1
test_partial_remove-add[3.10.0]  79.7852 (3.63)  79.7852 (3.63)  79.7852 (3.63)  0.0000 (1.0)  79.7852 (3.63)  0.0000 (1.0)  0;0 0.0125 (0.28)  1 1
test_partial_remove-add[3.53.2]  73.9985 (3.37)  73.9985 (3.37)  73.9985 (3.37)  0.0000 (1.0)  73.9985 (3.37)  0.0000 (1.0)  0;0 0.0135 (0.30)  1 1
test_partial_remove-add[3.60.1]  21.9770 (1.0)  21.9770 (1.0)  21.9770 (1.0)  0.0000 (1.0)  21.9770 (1.0)  0.0000 (1.0)  0;0 0.0455 (1.0)  1 1
test_partial_remove-add[main]  22.9727 (1.05)  22.9727 (1.05)  22.9727 (1.05)  0.0000 (1.0)  22.9727 (1.05)  0.0000 (1.0)  0;0 0.0435 (0.96)  1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]  7.9437 (7.76)  7.9437 (7.76)  7.9437 (7.76)  0.0000 (1.0)  7.9437 (7.76)  0.0000 (1.0)  0;0 0.1259 (0.13)  1 1
test_partial_remove-add-update[3.10.0]  7.9737 (7.79)  7.9737 (7.79)  7.9737 (7.79)  0.0000 (1.0)  7.9737 (7.79)  0.0000 (1.0)  0;0 0.1254 (0.13)  1 1
test_partial_remove-add-update[3.53.2]  7.0591 (6.90)  7.0591 (6.90)  7.0591 (6.90)  0.0000 (1.0)  7.0591 (6.90)  0.0000 (1.0)  0;0 0.1417 (0.14)  1 1
test_partial_remove-add-update[3.60.1]  1.0232 (1.0)  1.0232 (1.0)  1.0232 (1.0)  0.0000 (1.0)  1.0232 (1.0)  0.0000 (1.0)  0;0 0.9773 (1.0)  1 1
test_partial_remove-add-update[main]  1.0553 (1.03)  1.0553 (1.03)  1.0553 (1.03)  0.0000 (1.0)  1.0553 (1.03)  0.0000 (1.0)  0;0 0.9476 (0.97)  1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]  3.1667 (1.0)  3.1667 (1.0)  3.1667 (1.0)  0.0000 (1.0)  3.1667 (1.0)  0.0000 (1.0)  0;0 0.3158 (1.0)  1 1
test_partial_remove-gc[3.10.0]  3.6877 (1.16)  3.6877 (1.16)  3.6877 (1.16)  0.0000 (1.0)  3.6877 (1.16)  0.0000 (1.0)  0;0 0.2712 (0.86)  1 1
test_partial_remove-gc[3.53.2]  3.5015 (1.11)  3.5015 (1.11)  3.5015 (1.11)  0.0000 (1.0)  3.5015 (1.11)  0.0000 (1.0)  0;0 0.2856 (0.90)  1 1
test_partial_remove-gc[3.60.1]  3.5791 (1.13)  3.5791 (1.13)  3.5791 (1.13)  0.0000 (1.0)  3.5791 (1.13)  0.0000 (1.0)  0;0 0.2794 (0.88)  1 1
test_partial_remove-gc[main]  3.5976 (1.14)  3.5976 (1.14)  3.5976 (1.14)  0.0000 (1.0)  3.5976 (1.14)  0.0000 (1.0)  0;0 0.2780 (0.88)  1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]  4.5254 (1.0)  4.5254 (1.0)  4.5254 (1.0)  0.0000 (1.0)  4.5254 (1.0)  0.0000 (1.0)  0;0 0.2210 (1.0)  1 1
test_partial_remove-gc-cloud[3.10.0]  5.1382 (1.14)  5.1382 (1.14)  5.1382 (1.14)  0.0000 (1.0)  5.1382 (1.14)  0.0000 (1.0)  0;0 0.1946 (0.88)  1 1
test_partial_remove-gc-cloud[3.53.2]  4.7871 (1.06)  4.7871 (1.06)  4.7871 (1.06)  0.0000 (1.0)  4.7871 (1.06)  0.0000 (1.0)  0;0 0.2089 (0.95)  1 1
test_partial_remove-gc-cloud[3.60.1]  4.5817 (1.01)  4.5817 (1.01)  4.5817 (1.01)  0.0000 (1.0)  4.5817 (1.01)  0.0000 (1.0)  0;0 0.2183 (0.99)  1 1
test_partial_remove-gc-cloud[main]  4.7439 (1.05)  4.7439 (1.05)  4.7439 (1.05)  0.0000 (1.0)  4.7439 (1.05)  0.0000 (1.0)  0;0 0.2108 (0.95)  1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]  47.5781 (2.19)  47.5781 (2.19)  47.5781 (2.19)  0.0000 (1.0)  47.5781 (2.19)  0.0000 (1.0)  0;0 0.0210 (0.46)  1 1
test_partial_remove-push[3.10.0]  42.7027 (1.97)  42.7027 (1.97)  42.7027 (1.97)  0.0000 (1.0)  42.7027 (1.97)  0.0000 (1.0)  0;0 0.0234 (0.51)  1 1
test_partial_remove-push[3.53.2]  22.3804 (1.03)  22.3804 (1.03)  22.3804 (1.03)  0.0000 (1.0)  22.3804 (1.03)  0.0000 (1.0)  0;0 0.0447 (0.97)  1 1
test_partial_remove-push[3.60.1]  21.7248 (1.00)  21.7248 (1.00)  21.7248 (1.00)  0.0000 (1.0)  21.7248 (1.00)  0.0000 (1.0)  0;0 0.0460 (1.00)  1 1
test_partial_remove-push[main]  21.6981 (1.0)  21.6981 (1.0)  21.6981 (1.0)  0.0000 (1.0)  21.6981 (1.0)  0.0000 (1.0)  0;0 0.0461 (1.0)  1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]  1.8217 (1.02)  1.8217 (1.02)  1.8217 (1.02)  0.0000 (1.0)  1.8217 (1.02)  0.0000 (1.0)  0;0 0.5489 (0.98)  1 1
test_partial_remove-push-update[3.10.0]  1.7888 (1.0)  1.7888 (1.0)  1.7888 (1.0)  0.0000 (1.0)  1.7888 (1.0)  0.0000 (1.0)  0;0 0.5590 (1.0)  1 1
test_partial_remove-push-update[3.53.2]  2.4605 (1.38)  2.4605 (1.38)  2.4605 (1.38)  0.0000 (1.0)  2.4605 (1.38)  0.0000 (1.0)  0;0 0.4064 (0.73)  1 1
test_partial_remove-push-update[3.60.1]  2.6978 (1.51)  2.6978 (1.51)  2.6978 (1.51)  0.0000 (1.0)  2.6978 (1.51)  0.0000 (1.0)  0;0 0.3707 (0.66)  1 1
test_partial_remove-push-update[main]  2.4842 (1.39)  2.4842 (1.39)  2.4842 (1.39)  0.0000 (1.0)  2.4842 (1.39)  0.0000 (1.0)  0;0 0.4025 (0.72)  1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]  542.3671 (1.0)  549.5763 (1.0)  545.7573 (1.0)  2.7370 (1.0)  545.5497 (1.0)  3.8751 (1.0)  2;0 1.8323 (1.0)  5 3
test_plots-plots-diff[3.10.0]  968.7242 (1.79)  980.9827 (1.78)  973.3754 (1.78)  4.8364 (1.77)  972.1959 (1.78)  6.5967 (1.70)  1;0 1.0274 (0.56)  5 3
test_plots-plots-diff[3.53.2]  928.2865 (1.71)  948.2455 (1.73)  940.5157 (1.72)  7.4976 (2.74)  942.4887 (1.73)  8.0767 (2.08)  2;0 1.0632 (0.58)  5 3
test_plots-plots-diff[3.60.1]  909.8690 (1.68)  927.0181 (1.69)  922.5901 (1.69)  7.1699 (2.62)  925.8138 (1.70)  5.3246 (1.37)  1;1 1.0839 (0.59)  5 3
test_plots-plots-diff[main]  906.1289 (1.67)  920.1518 (1.67)  915.7970 (1.68)  5.5521 (2.03)  917.8433 (1.68)  4.7343 (1.22)  1;1 1.0919 (0.60)  5 3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]  559.6068 (1.0)  569.4837 (1.0)  565.7690 (1.0)  4.2488 (1.0)  567.5736 (1.0)  6.8392 (1.00)  1;0 1.7675 (1.0)  5 3
test_plots-plots-diff-json[3.10.0]  1,196.4774 (2.14)  1,218.3968 (2.14)  1,208.1240 (2.14)  8.4411 (1.99)  1,211.2496 (2.13)  11.5298 (1.69)  2;0 0.8277 (0.47)  5 3
test_plots-plots-diff-json[3.53.2]  975.3452 (1.74)  986.8357 (1.73)  982.0600 (1.74)  4.5585 (1.07)  982.5018 (1.73)  6.8284 (1.0)  2;0 1.0183 (0.58)  5 3
test_plots-plots-diff-json[3.60.1]  995.4669 (1.78)  1,028.5964 (1.81)  1,011.7912 (1.79)  12.2658 (2.89)  1,011.7255 (1.78)  15.9907 (2.34)  2;0 0.9883 (0.56)  5 3
test_plots-plots-diff-json[main]  981.6401 (1.75)  998.4153 (1.75)  992.7003 (1.75)  6.8964 (1.62)  994.0296 (1.75)  9.5415 (1.40)  1;0 1.0074 (0.57)  5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]  458.2415 (1.0)  474.5630 (1.0)  463.0209 (1.0)  6.8092 (2.46)  459.5692 (1.0)  7.7555 (1.51)  1;0 2.1597 (1.0)  5 3
test_plots-plots-show[3.10.0]  801.3859 (1.75)  823.3531 (1.73)  809.1103 (1.75)  8.7760 (3.17)  808.8032 (1.76)  10.9169 (2.12)  1;0 1.2359 (0.57)  5 3
test_plots-plots-show[3.53.2]  809.9745 (1.77)  827.5679 (1.74)  817.0479 (1.76)  8.0628 (2.92)  814.0191 (1.77)  14.4644 (2.81)  1;0 1.2239 (0.57)  5 3
test_plots-plots-show[3.60.1]  786.1716 (1.72)  806.7367 (1.70)  794.2646 (1.72)  9.6229 (3.48)  787.9744 (1.71)  16.1615 (3.14)  1;0 1.2590 (0.58)  5 3
test_plots-plots-show[main]  787.4466 (1.72)  793.2541 (1.67)  790.6388 (1.71)  2.7644 (1.0)  791.7458 (1.72)  5.1524 (1.0)  1;0 1.2648 (0.59)  5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]  467.4426 (1.0)  478.9251 (1.0)  473.3295 (1.0)  4.3948 (1.0)  472.3627 (1.0)  6.1511 (1.0)  2;0 2.1127 (1.0)  5 3
test_plots-plots-show-json[3.10.0]  924.5352 (1.98)  958.3263 (2.00)  939.6378 (1.99)  14.8210 (3.37)  943.2460 (2.00)  25.6292 (4.17)  3;0 1.0642 (0.50)  5 3
test_plots-plots-show-json[3.53.2]  862.6647 (1.85)  879.6402 (1.84)  870.5932 (1.84)  7.1540 (1.63)  868.1225 (1.84)  11.9648 (1.95)  2;0 1.1486 (0.54)  5 3
test_plots-plots-show-json[3.60.1]  844.6200 (1.81)  857.2434 (1.79)  851.6202 (1.80)  5.0904 (1.16)  853.9732 (1.81)  7.5305 (1.22)  2;0 1.1742 (0.56)  5 3
test_plots-plots-show-json[main]  840.5352 (1.80)  852.5089 (1.78)  846.0330 (1.79)  4.6749 (1.06)  845.8222 (1.79)  7.0901 (1.15)  2;0 1.1820 (0.56)  5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]  47.8328 (2.22)  47.8328 (2.22)  47.8328 (2.22)  0.0000 (1.0)  47.8328 (2.22)  0.0000 (1.0)  0;0 0.0209 (0.45)  1 1
test_push-push[3.10.0]  42.6186 (1.98)  42.6186 (1.98)  42.6186 (1.98)  0.0000 (1.0)  42.6186 (1.98)  0.0000 (1.0)  0;0 0.0235 (0.51)  1 1
test_push-push[3.53.2]  22.7710 (1.06)  22.7710 (1.06)  22.7710 (1.06)  0.0000 (1.0)  22.7710 (1.06)  0.0000 (1.0)  0;0 0.0439 (0.95)  1 1
test_push-push[3.60.1]  21.5533 (1.0)  21.5533 (1.0)  21.5533 (1.0)  0.0000 (1.0)  21.5533 (1.0)  0.0000 (1.0)  0;0 0.0464 (1.0)  1 1
test_push-push[main]  21.9022 (1.02)  21.9022 (1.02)  21.9022 (1.02)  0.0000 (1.0)  21.9022 (1.02)  0.0000 (1.0)  0;0 0.0457 (0.98)  1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]  60.0986 (2.74)  60.0986 (2.74)  60.0986 (2.74)  0.0000 (1.0)  60.0986 (2.74)  0.0000 (1.0)  0;0 0.0166 (0.37)  1 1
test_sharing-fetch[3.10.0]  65.2362 (2.97)  65.2362 (2.97)  65.2362 (2.97)  0.0000 (1.0)  65.2362 (2.97)  0.0000 (1.0)  0;0 0.0153 (0.34)  1 1
test_sharing-fetch[3.53.2]  31.9825 (1.46)  31.9825 (1.46)  31.9825 (1.46)  0.0000 (1.0)  31.9825 (1.46)  0.0000 (1.0)  0;0 0.0313 (0.69)  1 1
test_sharing-fetch[3.60.1]  21.9608 (1.0)  21.9608 (1.0)  21.9608 (1.0)  0.0000 (1.0)  21.9608 (1.0)  0.0000 (1.0)  0;0 0.0455 (1.0)  1 1
test_sharing-fetch[main]  22.1725 (1.01)  22.1725 (1.01)  22.1725 (1.01)  0.0000 (1.0)  22.1725 (1.01)  0.0000 (1.0)  0;0 0.0451 (0.99)  1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]  1.2479 (1.0)  1.2479 (1.0)  1.2479 (1.0)  0.0000 (1.0)  1.2479 (1.0)  0.0000 (1.0)  0;0 0.8013 (1.0)  1 1
test_sharing-fetch-noop[3.10.0]  3.5982 (2.88)  3.5982 (2.88)  3.5982 (2.88)  0.0000 (1.0)  3.5982 (2.88)  0.0000 (1.0)  0;0 0.2779 (0.35)  1 1
test_sharing-fetch-noop[3.53.2]  5.8025 (4.65)  5.8025 (4.65)  5.8025 (4.65)  0.0000 (1.0)  5.8025 (4.65)  0.0000 (1.0)  0;0 0.1723 (0.22)  1 1
test_sharing-fetch-noop[3.60.1]  5.7520 (4.61)  5.7520 (4.61)  5.7520 (4.61)  0.0000 (1.0)  5.7520 (4.61)  0.0000 (1.0)  0;0 0.1739 (0.22)  1 1
test_sharing-fetch-noop[main]  5.7834 (4.63)  5.7834 (4.63)  5.7834 (4.63)  0.0000 (1.0)  5.7834 (4.63)  0.0000 (1.0)  0;0 0.1729 (0.22)  1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]  48.5964 (2.25)  48.5964 (2.25)  48.5964 (2.25)  0.0000 (1.0)  48.5964 (2.25)  0.0000 (1.0)  0;0 0.0206 (0.44)  1 1
test_sharing-push[3.10.0]  43.8728 (2.03)  43.8728 (2.03)  43.8728 (2.03)  0.0000 (1.0)  43.8728 (2.03)  0.0000 (1.0)  0;0 0.0228 (0.49)  1 1
test_sharing-push[3.53.2]  23.0277 (1.07)  23.0277 (1.07)  23.0277 (1.07)  0.0000 (1.0)  23.0277 (1.07)  0.0000 (1.0)  0;0 0.0434 (0.94)  1 1
test_sharing-push[3.60.1]  21.5595 (1.0)  21.5595 (1.0)  21.5595 (1.0)  0.0000 (1.0)  21.5595 (1.0)  0.0000 (1.0)  0;0 0.0464 (1.0)  1 1
test_sharing-push[main]  21.6754 (1.01)  21.6754 (1.01)  21.6754 (1.01)  0.0000 (1.0)  21.6754 (1.01)  0.0000 (1.0)  0;0 0.0461 (0.99)  1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]  1.9856 (1.0)  1.9856 (1.0)  1.9856 (1.0)  0.0000 (1.0)  1.9856 (1.0)  0.0000 (1.0)  0;0 0.5036 (1.0)  1 1
test_sharing-push-noop[3.10.0]  1.9916 (1.00)  1.9916 (1.00)  1.9916 (1.00)  0.0000 (1.0)  1.9916 (1.00)  0.0000 (1.0)  0;0 0.5021 (1.00)  1 1
test_sharing-push-noop[3.53.2]  5.7272 (2.88)  5.7272 (2.88)  5.7272 (2.88)  0.0000 (1.0)  5.7272 (2.88)  0.0000 (1.0)  0;0 0.1746 (0.35)  1 1
test_sharing-push-noop[3.60.1]  5.7809 (2.91)  5.7809 (2.91)  5.7809 (2.91)  0.0000 (1.0)  5.7809 (2.91)  0.0000 (1.0)  0;0 0.1730 (0.34)  1 1
test_sharing-push-noop[main]  5.8548 (2.95)  5.8548 (2.95)  5.8548 (2.95)  0.0000 (1.0)  5.8548 (2.95)  0.0000 (1.0)  0;0 0.1708 (0.34)  1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]  161.7170 (1.07)  161.7170 (1.07)  161.7170 (1.07)  0.0000 (1.0)  161.7170 (1.07)  0.0000 (1.0)  0;0 0.0062 (0.93)  1 1
test_sharing_azure-fetch[main]  150.9622 (1.0)  150.9622 (1.0)  150.9622 (1.0)  0.0000 (1.0)  150.9622 (1.0)  0.0000 (1.0)  0;0 0.0066 (1.0)  1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]  6.1186 (1.0)  6.1186 (1.0)  6.1186 (1.0)  0.0000 (1.0)  6.1186 (1.0)  0.0000 (1.0)  0;0 0.1634 (1.0)  1 1
test_sharing_azure-fetch-noop[main]  6.3414 (1.04)  6.3414 (1.04)  6.3414 (1.04)  0.0000 (1.0)  6.3414 (1.04)  0.0000 (1.0)  0;0 0.1577 (0.96)  1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]  146.3551 (1.0)  146.3551 (1.0)  146.3551 (1.0)  0.0000 (1.0)  146.3551 (1.0)  0.0000 (1.0)  0;0 0.0068 (1.0)  1 1
test_sharing_azure-push[main]  147.3707 (1.01)  147.3707 (1.01)  147.3707 (1.01)  0.0000 (1.0)  147.3707 (1.01)  0.0000 (1.0)  0;0 0.0068 (0.99)  1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]  6.6145 (1.01)  6.6145 (1.01)  6.6145 (1.01)  0.0000 (1.0)  6.6145 (1.01)  0.0000 (1.0)  0;0 0.1512 (0.99)  1 1
test_sharing_azure-push-noop[main]  6.5701 (1.0)  6.5701 (1.0)  6.5701 (1.0)  0.0000 (1.0)  6.5701 (1.0)  0.0000 (1.0)  0;0 0.1522 (1.0)  1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]  701.7588 (1.02)  701.7588 (1.02)  701.7588 (1.02)  0.0000 (1.0)  701.7588 (1.02)  0.0000 (1.0)  0;0 0.0014 (0.98)  1 1
test_sharing_s3-fetch[main]  688.4342 (1.0)  688.4342 (1.0)  688.4342 (1.0)  0.0000 (1.0)  688.4342 (1.0)  0.0000 (1.0)  0;0 0.0015 (1.0)  1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]  6.3827 (1.0)  6.3827 (1.0)  6.3827 (1.0)  0.0000 (1.0)  6.3827 (1.0)  0.0000 (1.0)  0;0 0.1567 (1.0)  1 1
test_sharing_s3-fetch-noop[main]  6.4956 (1.02)  6.4956 (1.02)  6.4956 (1.02)  0.0000 (1.0)  6.4956 (1.02)  0.0000 (1.0)  0;0 0.1540 (0.98)  1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests --------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]  1,022.7312 (1.0)  1,022.7312 (1.0)  1,022.7312 (1.0)  0.0000 (1.0)  1,022.7312 (1.0)  0.0000 (1.0)  0;0 0.0010 (1.0)  1 1
test_sharing_s3-push[main]  1,026.9567 (1.00)  1,026.9567 (1.00)  1,026.9567 (1.00)  0.0000 (1.0)  1,026.9567 (1.00)  0.0000 (1.0)  0;0 0.0010 (1.00)  1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]  6.9044 (1.0)  6.9044 (1.0)  6.9044 (1.0)  0.0000 (1.0)  6.9044 (1.0)  0.0000 (1.0)  0;0 0.1448 (1.0)  1 1
test_sharing_s3-push-noop[main]  6.9492 (1.01)  6.9492 (1.01)  6.9492 (1.01)  0.0000 (1.0)  6.9492 (1.01)  0.0000 (1.0)  0;0 0.1439 (0.99)  1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]  18.7721 (3.84)  18.7721 (3.84)  18.7721 (3.84)  0.0000 (1.0)  18.7721 (3.84)  0.0000 (1.0)  0;0 0.0533 (0.26)  1 1
test_status-status[3.10.0]  19.4954 (3.99)  19.4954 (3.99)  19.4954 (3.99)  0.0000 (1.0)  19.4954 (3.99)  0.0000 (1.0)  0;0 0.0513 (0.25)  1 1
test_status-status[3.53.2]  19.9772 (4.09)  19.9772 (4.09)  19.9772 (4.09)  0.0000 (1.0)  19.9772 (4.09)  0.0000 (1.0)  0;0 0.0501 (0.24)  1 1
test_status-status[3.60.1]  4.8898 (1.0)  4.8898 (1.0)  4.8898 (1.0)  0.0000 (1.0)  4.8898 (1.0)  0.0000 (1.0)  0;0 0.2045 (1.0)  1 1
test_status-status[main]  5.1444 (1.05)  5.1444 (1.05)  5.1444 (1.05)  0.0000 (1.0)  5.1444 (1.05)  0.0000 (1.0)  0;0 0.1944 (0.95)  1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]  4.5919 (1.79)  4.5919 (1.79)  4.5919 (1.79)  0.0000 (1.0)  4.5919 (1.79)  0.0000 (1.0)  0;0 0.2178 (0.56)  1 1
test_status-status-changed[3.10.0]  4.9988 (1.94)  4.9988 (1.94)  4.9988 (1.94)  0.0000 (1.0)  4.9988 (1.94)  0.0000 (1.0)  0;0 0.2000 (0.51)  1 1
test_status-status-changed[3.53.2]  4.7640 (1.85)  4.7640 (1.85)  4.7640 (1.85)  0.0000 (1.0)  4.7640 (1.85)  0.0000 (1.0)  0;0 0.2099 (0.54)  1 1
test_status-status-changed[3.60.1]  2.5723 (1.0)  2.5723 (1.0)  2.5723 (1.0)  0.0000 (1.0)  2.5723 (1.0)  0.0000 (1.0)  0;0 0.3888 (1.0)  1 1
test_status-status-changed[main]  2.7949 (1.09)  2.7949 (1.09)  2.7949 (1.09)  0.0000 (1.0)  2.7949 (1.09)  0.0000 (1.0)  0;0 0.3578 (0.92)  1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]  4.6415 (1.89)  4.6415 (1.89)  4.6415 (1.89)  0.0000 (1.0)  4.6415 (1.89)  0.0000 (1.0)  0;0 0.2154 (0.53)  1 1
test_status-status-changed-noop[3.10.0]  4.8253 (1.96)  4.8253 (1.96)  4.8253 (1.96)  0.0000 (1.0)  4.8253 (1.96)  0.0000 (1.0)  0;0 0.2072 (0.51)  1 1
test_status-status-changed-noop[3.53.2]  4.8580 (1.97)  4.8580 (1.97)  4.8580 (1.97)  0.0000 (1.0)  4.8580 (1.97)  0.0000 (1.0)  0;0 0.2058 (0.51)  1 1
test_status-status-changed-noop[3.60.1]  2.4621 (1.0)  2.4621 (1.0)  2.4621 (1.0)  0.0000 (1.0)  2.4621 (1.0)  0.0000 (1.0)  0;0 0.4062 (1.0)  1 1
test_status-status-changed-noop[main]  2.6387 (1.07)  2.6387 (1.07)  2.6387 (1.07)  0.0000 (1.0)  2.6387 (1.07)  0.0000 (1.0)  0;0 0.3790 (0.93)  1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]  4.7110 (1.91)  4.7110 (1.91)  4.7110 (1.91)  0.0000 (1.0)  4.7110 (1.91)  0.0000 (1.0)  0;0 0.2123 (0.52)  1 1
test_status-status-noop[3.10.0]  4.9281 (2.00)  4.9281 (2.00)  4.9281 (2.00)  0.0000 (1.0)  4.9281 (2.00)  0.0000 (1.0)  0;0 0.2029 (0.50)  1 1
test_status-status-noop[3.53.2]  4.7990 (1.95)  4.7990 (1.95)  4.7990 (1.95)  0.0000 (1.0)  4.7990 (1.95)  0.0000 (1.0)  0;0 0.2084 (0.51)  1 1
test_status-status-noop[3.60.1]  2.4611 (1.0)  2.4611 (1.0)  2.4611 (1.0)  0.0000 (1.0)  2.4611 (1.0)  0.0000 (1.0)  0;0 0.4063 (1.0)  1 1
test_status-status-noop[main]  2.6253 (1.07)  2.6253 (1.07)  2.6253 (1.07)  0.0000 (1.0)  2.6253 (1.07)  0.0000 (1.0)  0;0 0.3809 (0.94)  1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]  147.0396 (3.30)  147.0396 (3.30)  147.0396 (3.30)  0.0000 (1.0)  147.0396 (3.30)  0.0000 (1.0)  0;0 0.0068 (0.30)  1 1
test_update-import-url[3.10.0]  150.2948 (3.37)  150.2948 (3.37)  150.2948 (3.37)  0.0000 (1.0)  150.2948 (3.37)  0.0000 (1.0)  0;0 0.0067 (0.30)  1 1
test_update-import-url[3.53.2]  113.1095 (2.54)  113.1095 (2.54)  113.1095 (2.54)  0.0000 (1.0)  113.1095 (2.54)  0.0000 (1.0)  0;0 0.0088 (0.39)  1 1
test_update-import-url[3.60.1]  44.5563 (1.0)  44.5563 (1.0)  44.5563 (1.0)  0.0000 (1.0)  44.5563 (1.0)  0.0000 (1.0)  0;0 0.0224 (1.0)  1 1
test_update-import-url[main]  45.4844 (1.02)  45.4844 (1.02)  45.4844 (1.02)  0.0000 (1.0)  45.4844 (1.02)  0.0000 (1.0)  0;0 0.0220 (0.98)  1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]  130.9866 (3.83)  130.9866 (3.83)  130.9866 (3.83)  0.0000 (1.0)  130.9866 (3.83)  0.0000 (1.0)  0;0 0.0076 (0.26)  1 1
test_update-update[3.10.0]  135.3608 (3.96)  135.3608 (3.96)  135.3608 (3.96)  0.0000 (1.0)  135.3608 (3.96)  0.0000 (1.0)  0;0 0.0074 (0.25)  1 1
test_update-update[3.53.2]  106.0847 (3.10)  106.0847 (3.10)  106.0847 (3.10)  0.0000 (1.0)  106.0847 (3.10)  0.0000 (1.0)  0;0 0.0094 (0.32)  1 1
test_update-update[3.60.1]  34.1811 (1.0)  34.1811 (1.0)  34.1811 (1.0)  0.0000 (1.0)  34.1811 (1.0)  0.0000 (1.0)  0;0 0.0293 (1.0)  1 1
test_update-update[main]  34.9851 (1.02)  34.9851 (1.02)  34.9851 (1.02)  0.0000 (1.0)  34.9851 (1.02)  0.0000 (1.0)  0;0 0.0286 (0.98)  1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]  16.1431 (2.21)  16.1431 (2.21)  16.1431 (2.21)  0.0000 (1.0)  16.1431 (2.21)  0.0000 (1.0)  0;0 0.0619 (0.45)  1 1
test_update-update-noop[3.10.0]  17.0950 (2.34)  17.0950 (2.34)  17.0950 (2.34)  0.0000 (1.0)  17.0950 (2.34)  0.0000 (1.0)  0;0 0.0585 (0.43)  1 1
test_update-update-noop[3.53.2]  16.5318 (2.26)  16.5318 (2.26)  16.5318 (2.26)  0.0000 (1.0)  16.5318 (2.26)  0.0000 (1.0)  0;0 0.0605 (0.44)  1 1
test_update-update-noop[3.60.1]  7.3152 (1.0)  7.3152 (1.0)  7.3152 (1.0)  0.0000 (1.0)  7.3152 (1.0)  0.0000 (1.0)  0;0 0.1367 (1.0)  1 1
test_update-update-noop[main]  7.8637 (1.07)  7.8637 (1.07)  7.8637 (1.07)  0.0000 (1.0)  7.8637 (1.07)  0.0000 (1.0)  0;0 0.1272 (0.93)  1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean