Comparison of build 629 and c06 (RHEL-8.6.0-20220510.3 and RHEL-8.6.0-20220510.3 )

Base
Target RHEL-8.6.0-20220510.3 build c06
Build 629 375 375 3c7 3c7 900 900 900 232 232 232 c06
Machine virtlab506 virtlab506 virtlab506 virtlab506 virtlab506 virtlab506 virtlab506 virtlab506 virtlab506 virtlab506 virtlab506 virtlab506
Distro
ARHEL-8.6.0-20220510.3
ARHEL-8.6.0-20220510.3
ARHEL-8.6.0-20220510.3
ARHEL-8.6.0-20220510.3
ARHEL-8.6.0-20220510.3
ARHEL-8.6.0-20220510.3
ARHEL-8.6.0-20220510.3
ARHEL-8.6.0-20220510.3
ARHEL-8.6.0-20220510.3
ARHEL-8.6.0-20220510.3
ARHEL-8.6.0-20220510.3
ARHEL-8.6.0-20220510.3
Guest distro DISTRO DISTRO DISTRO DISTRO DISTRO DISTRO DISTRO DISTRO DISTRO DISTRO DISTRO DISTRO
Runperf version 1.0.31 1.0.31 1.0.31 1.0.31 1.0.31 1.0.31 1.0.31 1.0.31 1.0.31 1.0.31 1.0.31 1.0.31
Runperf cmd
Fscripts/run-perf --host-setup-script sha1:92cf6e --host-setup-script-reboot --worker-setup-script sha1:a06015 -vvv --hosts virtlab506.REDHAT --distro DISTRO --default-password MASKED MASKED --profiles Localhost:{"qemu_bin": "/usr/local/bin/qemu-system-x86_64"} --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "60", "targets": "/fio", "block-sizes": "4,1024", "test-types": "read,write", "samples": "5", "__NAME__": "fio-nbd"}
Escripts/run-perf --host-setup-script sha1:e304fa --host-setup-script-reboot --worker-setup-script sha1:a06015 -vvv --hosts virtlab506.REDHAT --distro DISTRO --default-password MASKED MASKED --profiles Localhost:{"qemu_bin": "/usr/local/bin/qemu-system-x86_64"} --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "60", "targets": "/fio", "block-sizes": "4,1024", "test-types": "read,write", "samples": "5", "__NAME__": "fio-nbd"}
Escripts/run-perf --host-setup-script sha1:e304fa --host-setup-script-reboot --worker-setup-script sha1:a06015 -vvv --hosts virtlab506.REDHAT --distro DISTRO --default-password MASKED MASKED --profiles Localhost:{"qemu_bin": "/usr/local/bin/qemu-system-x86_64"} --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "60", "targets": "/fio", "block-sizes": "4,1024", "test-types": "read,write", "samples": "5", "__NAME__": "fio-nbd"}
Dscripts/run-perf --host-setup-script sha1:30868e --host-setup-script-reboot --worker-setup-script sha1:a06015 -vvv --hosts virtlab506.REDHAT --distro DISTRO --default-password MASKED MASKED --profiles Localhost:{"qemu_bin": "/usr/local/bin/qemu-system-x86_64"} --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "60", "targets": "/fio", "block-sizes": "4,1024", "test-types": "read,write", "samples": "5", "__NAME__": "fio-nbd"}
Dscripts/run-perf --host-setup-script sha1:30868e --host-setup-script-reboot --worker-setup-script sha1:a06015 -vvv --hosts virtlab506.REDHAT --distro DISTRO --default-password MASKED MASKED --profiles Localhost:{"qemu_bin": "/usr/local/bin/qemu-system-x86_64"} --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "60", "targets": "/fio", "block-sizes": "4,1024", "test-types": "read,write", "samples": "5", "__NAME__": "fio-nbd"}
Cscripts/run-perf --host-setup-script sha1:16ce29 --host-setup-script-reboot --worker-setup-script sha1:a06015 -vvv --hosts virtlab506.REDHAT --distro DISTRO --default-password MASKED MASKED --profiles Localhost:{"qemu_bin": "/usr/local/bin/qemu-system-x86_64"} --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "60", "targets": "/fio", "block-sizes": "4,1024", "test-types": "read,write", "samples": "5", "__NAME__": "fio-nbd"}
Cscripts/run-perf --host-setup-script sha1:16ce29 --host-setup-script-reboot --worker-setup-script sha1:a06015 -vvv --hosts virtlab506.REDHAT --distro DISTRO --default-password MASKED MASKED --profiles Localhost:{"qemu_bin": "/usr/local/bin/qemu-system-x86_64"} --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "60", "targets": "/fio", "block-sizes": "4,1024", "test-types": "read,write", "samples": "5", "__NAME__": "fio-nbd"}
Cscripts/run-perf --host-setup-script sha1:16ce29 --host-setup-script-reboot --worker-setup-script sha1:a06015 -vvv --hosts virtlab506.REDHAT --distro DISTRO --default-password MASKED MASKED --profiles Localhost:{"qemu_bin": "/usr/local/bin/qemu-system-x86_64"} --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "60", "targets": "/fio", "block-sizes": "4,1024", "test-types": "read,write", "samples": "5", "__NAME__": "fio-nbd"}
Bscripts/run-perf --host-setup-script sha1:5ba6f8 --host-setup-script-reboot --worker-setup-script sha1:a06015 -vvv --hosts virtlab506.REDHAT --distro DISTRO --default-password MASKED MASKED --profiles Localhost:{"qemu_bin": "/usr/local/bin/qemu-system-x86_64"} --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "60", "targets": "/fio", "block-sizes": "4,1024", "test-types": "read,write", "samples": "5", "__NAME__": "fio-nbd"}
Bscripts/run-perf --host-setup-script sha1:5ba6f8 --host-setup-script-reboot --worker-setup-script sha1:a06015 -vvv --hosts virtlab506.REDHAT --distro DISTRO --default-password MASKED MASKED --profiles Localhost:{"qemu_bin": "/usr/local/bin/qemu-system-x86_64"} --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "60", "targets": "/fio", "block-sizes": "4,1024", "test-types": "read,write", "samples": "5", "__NAME__": "fio-nbd"}
Bscripts/run-perf --host-setup-script sha1:5ba6f8 --host-setup-script-reboot --worker-setup-script sha1:a06015 -vvv --hosts virtlab506.REDHAT --distro DISTRO --default-password MASKED MASKED --profiles Localhost:{"qemu_bin": "/usr/local/bin/qemu-system-x86_64"} --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "60", "targets": "/fio", "block-sizes": "4,1024", "test-types": "read,write", "samples": "5", "__NAME__": "fio-nbd"}
Ascripts/run-perf --host-setup-script sha1:94cd6b --host-setup-script-reboot --worker-setup-script sha1:a06015 -vvv --hosts virtlab506.REDHAT --distro DISTRO --default-password MASKED MASKED --profiles Localhost:{"qemu_bin": "/usr/local/bin/qemu-system-x86_64"} --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "60", "targets": "/fio", "block-sizes": "4,1024", "test-types": "read,write", "samples": "5", "__NAME__": "fio-nbd"}
World env
Localhost env
Tests env
ATests with different params from src build:
ATests with different params from src build:
ATests with different params from src build:
ATests with different params from src build:
ATests with different params from src build:
ATests with different params from src build:
ATests with different params from src build:
ATests with different params from src build:
ATests with different params from src build:
ATests with different params from src build:
ATests with different params from src build:
ATests with different params from src build:
Failures 0 0 0 0 0 0 1 1 1 1 1
Group failures 0 0 0 0 0 0 0 0 0 0 0
Non-primary failures 3 0 1 3 1 2 5 5 3 0 4
Runtime errors 0 0 0 0 0 0 0 0 0 0 0
Total checks 37 37 37 37 37 37 37 37 37 37 37
Build score 0 0 0 0 0 0 0 1 1 1 1 1

Group stats

[-]
This build status: equals minor gains minor losses skips losses gains errors +good -good +bad -bad
Any build status: equals minor gains minor losses skips losses gains errors +good -good +bad -bad
types: MEAN STDDEV
Test 375 375 3c7 3c7 900 900 900 232 232 232 c06
*/fio-nbd/0000:./read-*/throughput/iops_sec.mean*/fio-nbd/0000:./read-*/throughput/iops_sec.mean
1.5GOOD raw 1.53% (1.53; 1.5300824407522984) +-5.75% tolerance
0.2GOOD raw 0.23% (0.23; 0.22784536560681456) +-5.75% tolerance
-0.1GOOD raw -0.08% (-0.08; -0.08473370161086277) +-5.75% tolerance
0.2GOOD raw 0.24% (0.24; 0.24379058783840768) +-5.75% tolerance
1.3GOOD raw 1.33% (1.33; 1.3252983469680357) +-5.75% tolerance
-1.7GOOD raw -1.71% (-1.71; -1.7056116639959518) +-5.75% tolerance
2.8GOOD raw 2.79% (2.79; 2.794235472716539) +-5.75% tolerance
1.3GOOD raw 1.34% (1.34; 1.3429566922493041) +-5.75% tolerance
3.2GOOD raw 3.19% (3.19; 3.1882537741418573) +-5.75% tolerance
0.8GOOD raw 0.79% (0.79; 0.789749725900312) +-5.75% tolerance
3.1GOOD raw 3.14% (3.14; 3.1398909926625627) +-5.75% tolerance
*/fio-nbd/0000:./write-*/throughput/iops_sec.mean*/fio-nbd/0000:./write-*/throughput/iops_sec.mean
-1.3GOOD raw -1.26% (-1.26; -1.2623574865354739) +-5.75% tolerance
-0.2GOOD raw -0.22% (-0.22; -0.2196189668293311) +-5.75% tolerance
0.9GOOD raw 0.93% (0.93; 0.927699462783066) +-5.75% tolerance
0.1GOOD raw 0.05% (0.05; 0.05158188890750093) +-5.75% tolerance
1.6GOOD raw 1.57% (1.57; 1.5729528249985578) +-5.75% tolerance
0.2GOOD raw 0.25% (0.25; 0.24546193246194403) +-5.75% tolerance
1.2GOOD raw 1.19% (1.19; 1.1874990101525689) +-5.75% tolerance
4.6GOOD raw 4.64% (4.64; 4.637321057259943) +-5.75% tolerance
1.9GOOD raw 1.94% (1.94; 1.9440430143475567) +-5.75% tolerance
2.4GOOD raw 2.36% (2.36; 2.3605303524504224) +-5.75% tolerance
2.9GOOD raw 2.88% (2.88; 2.8753348285376163) +-5.75% tolerance
Localhost/*/*:./*-*/*/*.meanLocalhost/*/*:./*-*/*/*.mean
0.1GOOD raw 0.13% (0.13; 0.13386247710841231) +-3.5% tolerance
0.0GOOD raw 0.00% (0.00; 0.004113199388741725) +-3.5% tolerance
0.4GOOD raw 0.42% (0.42; 0.4214828805861016) +-3.5% tolerance
0.1GOOD raw 0.15% (0.15; 0.1476862383729543) +-3.5% tolerance
1.4GOOD raw 1.45% (1.45; 1.449125585983297) +-3.5% tolerance
-0.7GOOD raw -0.73% (-0.73; -0.7300748657670039) +-3.5% tolerance
2.0GOOD raw 1.99% (1.99; 1.990867241434554) +-3.5% tolerance
3.0GOOD raw 2.99% (2.99; 2.9901388747546234) +-3.5% tolerance
2.6GOOD raw 2.57% (2.57; 2.566148394244707) +-3.5% tolerance
1.6GOOD raw 1.58% (1.58; 1.5751400391753672) +-3.5% tolerance
3.0GOOD raw 3.01% (3.01; 3.0076129106000895) +-3.5% tolerance
Localhost/fio-nbd/0000:./read-*/throughput/iops_sec.meanLocalhost/fio-nbd/0000:./read-*/throughput/iops_sec.mean
1.5GOOD raw 1.53% (1.53; 1.5300824407522984) +-5.75% tolerance
0.2GOOD raw 0.23% (0.23; 0.22784536560681456) +-5.75% tolerance
-0.1GOOD raw -0.08% (-0.08; -0.08473370161086277) +-5.75% tolerance
0.2GOOD raw 0.24% (0.24; 0.24379058783840768) +-5.75% tolerance
1.3GOOD raw 1.33% (1.33; 1.3252983469680357) +-5.75% tolerance
-1.7GOOD raw -1.71% (-1.71; -1.7056116639959518) +-5.75% tolerance
2.8GOOD raw 2.79% (2.79; 2.794235472716539) +-5.75% tolerance
1.3GOOD raw 1.34% (1.34; 1.3429566922493041) +-5.75% tolerance
3.2GOOD raw 3.19% (3.19; 3.1882537741418573) +-5.75% tolerance
0.8GOOD raw 0.79% (0.79; 0.789749725900312) +-5.75% tolerance
3.1GOOD raw 3.14% (3.14; 3.1398909926625627) +-5.75% tolerance
Localhost/fio-nbd/0000:./write-*/throughput/iops_sec.meanLocalhost/fio-nbd/0000:./write-*/throughput/iops_sec.mean
-1.3GOOD raw -1.26% (-1.26; -1.2623574865354739) +-5.75% tolerance
-0.2GOOD raw -0.22% (-0.22; -0.2196189668293311) +-5.75% tolerance
0.9GOOD raw 0.93% (0.93; 0.927699462783066) +-5.75% tolerance
0.1GOOD raw 0.05% (0.05; 0.05158188890750093) +-5.75% tolerance
1.6GOOD raw 1.57% (1.57; 1.5729528249985578) +-5.75% tolerance
0.2GOOD raw 0.25% (0.25; 0.24546193246194403) +-5.75% tolerance
1.2GOOD raw 1.19% (1.19; 1.1874990101525689) +-5.75% tolerance
4.6GOOD raw 4.64% (4.64; 4.637321057259943) +-5.75% tolerance
1.9GOOD raw 1.94% (1.94; 1.9440430143475567) +-5.75% tolerance
2.4GOOD raw 2.36% (2.36; 2.3605303524504224) +-5.75% tolerance
2.9GOOD raw 2.88% (2.88; 2.8753348285376163) +-5.75% tolerance

Failures

[-]
This build status: equals minor gains minor losses skips losses gains errors +good -good +bad -bad
Any build status: equals minor gains minor losses skips losses gains errors +good -good +bad -bad
profiles: * LOCALHOST
tests: FIO-NBD
types: MEAN STDDEV
Test 375 375 3c7 3c7 900 900 900 232 232 232 c06
Localhost/fio-nbd/0000:./read-1024KiB/throughput/iops_sec.mean🔧Localhost/fio-nbd/0000:./read-1024KiB/throughput/iops_sec.mean
Click to copy raw src test params
-0.3GOOD raw -0.31% (22720; 22650) +-5% tolerance
0.0GOOD raw 0.04% (22720; 22730) +-5% tolerance
-0.1GOOD raw -0.13% (22720; 22690) +-5% tolerance
0.1GOOD raw 0.13% (22720; 22750) +-5% tolerance
-0.0GOOD raw -0.04% (22720; 22710) +-5% tolerance
0.1GOOD raw 0.09% (22720; 22740) +-5% tolerance
-0.0GOOD raw -0.04% (22720; 22710) +-5% tolerance
-0.3GOOD raw -0.31% (22720; 22650) +-5% tolerance
0.2GOOD raw 0.22% (22720; 22770) +-5% tolerance
0.2GOOD raw 0.18% (22720; 22760) +-5% tolerance
-0.2GOOD raw -0.18% (22720; 22680) +-5% tolerance
Localhost/fio-nbd/0000:./read-1024KiB/throughput/iops_sec.stddev🔧Localhost/fio-nbd/0000:./read-1024KiB/throughput/iops_sec.stddev
Click to copy raw src test params
-0.3GOOD raw -0.30% (0.19; 0.481) +-5% tolerance
-0.4GOOD raw -0.37% (0.19; 0.5535) +-5% tolerance
-0.3GOOD raw -0.26% (0.19; 0.448) +-5% tolerance
-0.4GOOD raw -0.42% (0.19; 0.6099) +-5% tolerance
-0.2GOOD raw -0.15% (0.19; 0.3353) +-5% tolerance
-0.4GOOD raw -0.38% (0.19; 0.5675) +-5% tolerance
-0.3GOOD raw -0.31% (0.19; 0.4994) +-5% tolerance
-0.3GOOD raw -0.30% (0.19; 0.4892) +-5% tolerance
-0.3GOOD raw -0.28% (0.19; 0.4622) +-5% tolerance
-0.4GOOD raw -0.40% (0.19; 0.5894) +-5% tolerance
-0.2GOOD raw -0.17% (0.19; 0.3566) +-5% tolerance
Localhost/fio-nbd/0000:./read-4KiB/throughput/iops_sec.mean🔧Localhost/fio-nbd/0000:./read-4KiB/throughput/iops_sec.mean
Click to copy raw src test params
3.4GOOD raw 3.37% (534400; 552400) +-5% tolerance
0.4GOOD raw 0.41% (534400; 536600) +-5% tolerance
-0.0GOOD raw -0.04% (534400; 534200) +-5% tolerance
0.4GOOD raw 0.36% (534400; 536300) +-5% tolerance
2.7GOOD raw 2.69% (534400; 548800) +-5% tolerance
-3.5GOOD raw -3.50% (534400; 515700) +-5% tolerance
5.6BIG raw 5.63% (534400; 564500) +-5% tolerance
3.0GOOD raw 2.99% (534400; 550400) +-5% tolerance
6.2BIG raw 6.16% (534400; 567300) +-5% tolerance
1.4GOOD raw 1.40% (534400; 541900) +-5% tolerance
6.5BIG raw 6.46% (534400; 568900) +-5% tolerance
Localhost/fio-nbd/0000:./read-4KiB/throughput/iops_sec.stddev🔧Localhost/fio-nbd/0000:./read-4KiB/throughput/iops_sec.stddev
Click to copy raw src test params
0.6GOOD raw 0.64% (1.90; 1.263) +-5% tolerance
0.6GOOD raw 0.60% (1.90; 1.298) +-5% tolerance
-0.6GOOD raw -0.63% (1.90; 2.529) +-5% tolerance
0.2GOOD raw 0.22% (1.90; 1.683) +-5% tolerance
0.2GOOD raw 0.21% (1.90; 1.69) +-5% tolerance
1.1GOOD raw 1.13% (1.90; 0.7706) +-5% tolerance
1.2GOOD raw 1.19% (1.90; 0.7095) +-5% tolerance
0.6GOOD raw 0.64% (1.90; 1.257) +-5% tolerance
0.4GOOD raw 0.43% (1.90; 1.476) +-5% tolerance
0.3GOOD raw 0.33% (1.90; 1.574) +-5% tolerance
0.4GOOD raw 0.43% (1.90; 1.476) +-5% tolerance
Localhost/fio-nbd/0000:./write-1024KiB/throughput/iops_sec.mean🔧Localhost/fio-nbd/0000:./write-1024KiB/throughput/iops_sec.mean
Click to copy raw src test params
-0.9GOOD raw -0.91% (7337; 7270) +-5% tolerance
0.0GOOD raw 0.03% (7337; 7339) +-5% tolerance
-0.1GOOD raw -0.10% (7337; 7330) +-5% tolerance
-1.3GOOD raw -1.25% (7337; 7245) +-5% tolerance
-0.6GOOD raw -0.59% (7337; 7294) +-5% tolerance
-1.4GOOD raw -1.42% (7337; 7233) +-5% tolerance
-0.8GOOD raw -0.76% (7337; 7281) +-5% tolerance
5.7BIG raw 5.67% (7337; 7753) +-5% tolerance
-0.8GOOD raw -0.78% (7337; 7280) +-5% tolerance
-0.4GOOD raw -0.37% (7337; 7310) +-5% tolerance
2.0GOOD raw 1.98% (7337; 7482) +-5% tolerance
Localhost/fio-nbd/0000:./write-1024KiB/throughput/iops_sec.stddev🔧Localhost/fio-nbd/0000:./write-1024KiB/throughput/iops_sec.stddev
Click to copy raw src test params
0.0GOOD raw 0.03% (0.57; 0.5409) +-5% tolerance
0.1GOOD raw 0.09% (0.57; 0.4848) +-5% tolerance
-1.7GOOD raw -1.67% (0.57; 2.238) +-5% tolerance
-0.5GOOD raw -0.49% (0.57; 1.064) +-5% tolerance
0.0GOOD raw 0.03% (0.57; 0.5455) +-5% tolerance
0.2GOOD raw 0.17% (0.57; 0.4049) +-5% tolerance
-1.5GOOD raw -1.48% (0.57; 2.053) +-5% tolerance
-1.3GOOD raw -1.27% (0.57; 1.841) +-5% tolerance
-0.0GOOD raw -0.04% (0.57; 0.6148) +-5% tolerance
-1.0GOOD raw -1.04% (0.57; 1.616) +-5% tolerance
-1.6GOOD raw -1.62% (0.57; 2.192) +-5% tolerance
Localhost/fio-nbd/0000:./write-4KiB/throughput/iops_sec.mean🔧Localhost/fio-nbd/0000:./write-4KiB/throughput/iops_sec.mean
Click to copy raw src test params
-1.6GOOD raw -1.61% (235800; 232000) +-5% tolerance
-0.5GOOD raw -0.47% (235800; 234700) +-5% tolerance
2.0GOOD raw 1.95% (235800; 240400) +-5% tolerance
1.4GOOD raw 1.36% (235800; 239000) +-5% tolerance
3.7GOOD raw 3.73% (235800; 244600) +-5% tolerance
1.9GOOD raw 1.91% (235800; 240300) +-5% tolerance
3.1GOOD raw 3.14% (235800; 243200) +-5% tolerance
3.6GOOD raw 3.60% (235800; 244300) +-5% tolerance
4.7GOOD raw 4.66% (235800; 246800) +-5% tolerance
5.1BIG raw 5.09% (235800; 247800) +-5% tolerance
3.8GOOD raw 3.77% (235800; 244700) +-5% tolerance
Localhost/fio-nbd/0000:./write-4KiB/throughput/iops_sec.stddev🔧Localhost/fio-nbd/0000:./write-4KiB/throughput/iops_sec.stddev
Click to copy raw src test params
-0.0GOOD raw -0.04% (0.70; 0.7375) +-5% tolerance
-0.7GOOD raw -0.72% (0.70; 1.427) +-5% tolerance
-0.8GOOD raw -0.76% (0.70; 1.465) +-5% tolerance
-2.0GOOD raw -1.95% (0.70; 2.656) +-5% tolerance
-1.4GOOD raw -1.37% (0.70; 2.071) +-5% tolerance
-1.2GOOD raw -1.22% (0.70; 1.924) +-5% tolerance
-0.1GOOD raw -0.12% (0.70; 0.8203) +-5% tolerance
0.1GOOD raw 0.15% (0.70; 0.5565) +-5% tolerance
-0.5GOOD raw -0.47% (0.70; 1.176) +-5% tolerance
-1.0GOOD raw -1.00% (0.70; 1.7) +-5% tolerance
0.1GOOD raw 0.07% (0.70; 0.6323) +-5% tolerance

Details

[+]