2021-08-19T22:39:32.066 INFO:root:teuthology version: 1.1.0-321319b1 2021-08-19T22:39:32.068 INFO:teuthology.results:subset: '111/120000' 2021-08-19T22:39:32.068 INFO:teuthology.results:seed: '8971' 2021-08-20T02:25:21.870 INFO:root:teuthology version: 1.1.0-321319b1 2021-08-20T02:25:21.907 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-08-20T13:51:19.800 INFO:teuthology.results:Tests finished! gathering results... 2021-08-20T13:51:52.340 INFO:scrape:Found 325 jobs 2021-08-20T13:51:53.170 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-7120-g53b16a84 (53b16a841493c8dd0aa26936b0cc2246dfc0fc13) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f4b8ff25b20] , 2: gsignal() 2021-08-20T13:51:53.171 WARNING:scrape:Ignoring malparsed backtrace: 2021-08-19T23:01:53.169 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers , 2021-08-19T23:01:53.220 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump , 2021-08-19T23:01:53.232 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-08-20T13:51:53.182 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-7120-g53b16a84 (53b16a841493c8dd0aa26936b0cc2246dfc0fc13) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f4b8ff25b20] , 2: gsignal() 2021-08-20T13:51:53.183 WARNING:scrape:Ignoring malparsed backtrace: 2021-08-19T23:01:53.169 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers , 2021-08-19T23:01:53.220 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump , 2021-08-19T23:01:53.232 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-08-20T13:51:53.193 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-7120-g53b16a84 (53b16a841493c8dd0aa26936b0cc2246dfc0fc13) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f4b8ff25b20] , 2: gsignal() 2021-08-20T13:51:53.194 WARNING:scrape:Ignoring malparsed backtrace: 2021-08-19T23:01:53.169 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers , 2021-08-19T23:01:53.220 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump , 2021-08-19T23:01:53.232 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-08-20T13:51:53.205 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-7120-g53b16a84 (53b16a841493c8dd0aa26936b0cc2246dfc0fc13) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f4b8ff25b20] , 2: gsignal() 2021-08-20T13:51:53.206 WARNING:scrape:Ignoring malparsed backtrace: 2021-08-19T23:01:53.169 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers , 2021-08-19T23:01:53.220 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump , 2021-08-19T23:01:53.232 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-08-20T13:51:53.216 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-7120-g53b16a84 (53b16a841493c8dd0aa26936b0cc2246dfc0fc13) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f4b8ff25b20] , 2: gsignal() 2021-08-20T13:51:53.217 WARNING:scrape:Ignoring malparsed backtrace: 2021-08-19T23:01:53.169 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers , 2021-08-19T23:01:53.220 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump , 2021-08-19T23:01:53.232 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-08-20T13:51:53.226 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-7120-g53b16a84 (53b16a841493c8dd0aa26936b0cc2246dfc0fc13) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f4b8ff25b20] , 2: gsignal() 2021-08-20T13:51:53.231 WARNING:scrape:Ignoring malparsed backtrace: 2021-08-19T23:01:53.169 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers , 2021-08-19T23:01:53.220 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump , 2021-08-19T23:01:53.232 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-08-20T13:51:54.849 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-7120-g53b16a84 (53b16a841493c8dd0aa26936b0cc2246dfc0fc13) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7fb9eccfcb20] , 2: gsignal() 2021-08-20T13:51:54.851 WARNING:scrape:Ignoring malparsed backtrace: 2021-08-19T23:15:44.419 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers , 2021-08-19T23:15:44.471 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump , 2021-08-19T23:15:44.492 DEBUG:teuthology.orchestra.run.smithi204:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-08-20T13:51:54.869 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-7120-g53b16a84 (53b16a841493c8dd0aa26936b0cc2246dfc0fc13) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7fb9eccfcb20] , 2: gsignal() 2021-08-20T13:51:54.870 WARNING:scrape:Ignoring malparsed backtrace: 2021-08-19T23:15:44.419 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers , 2021-08-19T23:15:44.471 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump , 2021-08-19T23:15:44.492 DEBUG:teuthology.orchestra.run.smithi204:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-08-20T13:51:54.885 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-7120-g53b16a84 (53b16a841493c8dd0aa26936b0cc2246dfc0fc13) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7fb9eccfcb20] , 2: gsignal() 2021-08-20T13:51:54.886 WARNING:scrape:Ignoring malparsed backtrace: 2021-08-19T23:15:44.419 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers , 2021-08-19T23:15:44.471 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump , 2021-08-19T23:15:44.492 DEBUG:teuthology.orchestra.run.smithi204:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-08-20T13:51:54.901 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-7120-g53b16a84 (53b16a841493c8dd0aa26936b0cc2246dfc0fc13) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7fb9eccfcb20] , 2: gsignal() 2021-08-20T13:51:54.903 WARNING:scrape:Ignoring malparsed backtrace: 2021-08-19T23:15:44.419 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers , 2021-08-19T23:15:44.471 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump , 2021-08-19T23:15:44.492 DEBUG:teuthology.orchestra.run.smithi204:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-08-20T13:52:01.742 INFO:scrape:Found 10 distinct failure reasons 2021-08-20T13:52:01.744 INFO:scrape:Failure: 'check osd count' reached maximum tries (90) after waiting for 900 seconds 2021-08-20T13:52:01.744 INFO:scrape:1 jobs: ['6347787'] 2021-08-20T13:52:01.745 INFO:scrape:suites: ['0-kubeadm', '1-rook', '2-workload/none', '3-final', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}'] 2021-08-20T13:52:01.746 INFO:scrape: 2021-08-20T13:52:01.746 INFO:scrape:Failure: Command failed on smithi042 with status 5: 'sudo systemctl stop ceph-85611f6c-0144-11ec-8c24-001a4aab830c@mon.a' 2021-08-20T13:52:01.747 INFO:scrape:15 jobs: ['6347542', '6347460', '6347614', '6347771', '6347785', '6347678', '6347466', '6347454', '6347564', '6347588', '6347923', '6347889', '6347865', '6347895', '6347993'] 2021-08-20T13:52:01.747 INFO:scrape:suites intersection: [] 2021-08-20T13:52:01.748 INFO:scrape:suites union: ['1-bootstrap/16.2.4', '1-bootstrap/16.2.5', '1-bootstrap/octopus', '1-start', '2-nfs', '2-thrash', '3-tasks/rados_api_tests', '3-tasks/radosbench', '3-tasks/small-objects', '3-tasks/snaps-few-objects', '3-upgrade-with-workload', '4-final}', 'debug/mgr', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_kubic_stable', 'rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable', 'rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable', 'rados/dashboard/{centos_8.2_kubic_stable', 'random-objectstore$/{bluestore-bitmap}', 'random-objectstore$/{bluestore-comp-lz4}', 'root}', 'task/test_nfs}', 'task/test_orch_cli}', 'tasks/e2e}'] 2021-08-20T13:52:01.748 INFO:scrape: 2021-08-20T13:52:01.749 INFO:scrape:Dead: b'2021-08-20T13:47:58.935 DEBUG:teuthology.exit:Finished running handlers' 2021-08-20T13:52:01.749 INFO:scrape:2 jobs: ['6347929', '6347706'] 2021-08-20T13:52:01.750 INFO:scrape:suites intersection: ['msgr-failures/few', 'openstack}', 'rados', 'thrashosds-health'] 2021-08-20T13:52:01.750 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/peering_and_degraded', 'ceph', 'cluster/{12-osds', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'recovery-overrides/{more-async-partial-recovery}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/mapgap', 'thrashers/pggrow', 'thrashosds-health', 'workloads/dedup-io-snaps}', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}'] 2021-08-20T13:52:01.751 INFO:scrape: 2021-08-20T13:52:01.751 INFO:scrape:Failure: Command failed (workunit test cls/test_cls_rgw.sh) on smithi103 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=pacific TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh' 2021-08-20T13:52:01.752 INFO:scrape:6 jobs: ['6347949', '6347627', '6347609', '6347951', '6347504', '6347750'] 2021-08-20T13:52:01.752 INFO:scrape:suites intersection: [] 2021-08-20T13:52:01.753 INFO:scrape:suites union: ['0-start', '1-tasks', 'ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'd-thrash/none', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/upgrade/parallel/{0-distro$/{centos_8.3_container_tools_3.0}', 'rados/upgrade/parallel/{0-distro$/{ubuntu_20.04}', 'rados/verify/{centos_latest', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'supported-random-distro$/{centos_8.stream}', 'tasks/rados_cls_all', 'tasks/rados_cls_all}', 'test_rbd_api', 'test_rbd_python}}', 'thrashosds-health}', 'upgrade-sequence', 'validater/lockdep}', 'validater/valgrind}', 'workload/{ec-rados-default'] 2021-08-20T13:52:01.753 INFO:scrape: 2021-08-20T13:52:01.754 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'mkdir $TESTDIR/archive/ostest && cd $TESTDIR/archive/ostest && ulimit -Sn 16384 && CEPH_ARGS="--no-log-to-stderr --log-file $TESTDIR/archive/ceph_test_objectstore.log --debug-bluestore 20" ceph_test_objectstore --gtest_filter=*SyntheticMatrixC*/2 --gtest_catch_exceptions=0\'' 2021-08-20T13:52:01.754 INFO:scrape:2 jobs: ['6347506', '6347458'] 2021-08-20T13:52:01.755 INFO:scrape:suites intersection: [] 2021-08-20T13:52:01.755 INFO:scrape:suites union: ['rados/objectstore/{backends/objectstore-bluestore-a', 'rados/objectstore/{backends/objectstore-bluestore-b', 'supported-random-distro$/{centos_8.stream}}', 'supported-random-distro$/{centos_8}}'] 2021-08-20T13:52:01.756 INFO:scrape: 2021-08-20T13:52:01.756 INFO:scrape:Failure: Command failed (workunit test cephadm/test_adoption.sh) on smithi064 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=53b16a841493c8dd0aa26936b0cc2246dfc0fc13 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' 2021-08-20T13:52:01.757 INFO:scrape:1 jobs: ['6347714'] 2021-08-20T13:52:01.757 INFO:scrape:suites: ['mon_election/classic', 'rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable', 'task/test_adoption}'] 2021-08-20T13:52:01.758 INFO:scrape: 2021-08-20T13:52:01.758 INFO:scrape:Failure: Command failed on smithi168 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:53b16a841493c8dd0aa26936b0cc2246dfc0fc13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 306b391e-015a-11ec-8c24-001a4aab830c -- ceph mon dump -f json' 2021-08-20T13:52:01.759 INFO:scrape:2 jobs: ['6347941', '6347658'] 2021-08-20T13:52:01.759 INFO:scrape:suites intersection: ['1-start', '3-final}', 'rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0'] 2021-08-20T13:52:01.759 INFO:scrape:suites union: ['1-start', '2-services/basic', '2-services/rgw', '3-final}', 'rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0'] 2021-08-20T13:52:01.760 INFO:scrape: 2021-08-20T13:52:01.760 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi090 with status 126: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=53b16a841493c8dd0aa26936b0cc2246dfc0fc13 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2021-08-20T13:52:01.761 INFO:scrape:2 jobs: ['6347444', '6347746'] 2021-08-20T13:52:01.761 INFO:scrape:suites intersection: ['rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable', 'task/test_cephadm}'] 2021-08-20T13:52:01.762 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable', 'task/test_cephadm}'] 2021-08-20T13:52:01.762 INFO:scrape: 2021-08-20T13:52:01.763 INFO:scrape:Failure: timeout expired in wait_for_all_osds_up 2021-08-20T13:52:01.763 INFO:scrape:1 jobs: ['6347945'] 2021-08-20T13:52:01.764 INFO:scrape:suites: ['0-kubeadm', '1-rook', '2-workload/radosbench', '3-final', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.0}'] 2021-08-20T13:52:01.764 INFO:scrape: 2021-08-20T13:52:01.764 INFO:scrape:Failure: Test failure: test_standby (tasks.mgr.test_prometheus.TestPrometheus) 2021-08-20T13:52:01.765 INFO:scrape:1 jobs: ['6347716'] 2021-08-20T13:52:01.766 INFO:scrape:suites: ['debug/mgr', 'mon_election/connectivity', 'objectstore/bluestore-low-osd-mem-target', 'rados/mgr/{clusters/{2-node-mgr}', 'supported-random-distro$/{rhel_8}', 'tasks/prometheus}'] 2021-08-20T13:52:01.766 INFO:scrape: 2021-08-20T13:52:01.778 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/ failed: 31 dead: 2 running: 0 waiting: 0 queued: 0 passed: 292 Fail ================================================================= [6347444] rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:11:08 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347444/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347444/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3d84e777f17041ad9d924c5e27b6a364 Command failed (workunit test cephadm/test_cephadm.sh) on smithi090 with status 126: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=53b16a841493c8dd0aa26936b0cc2246dfc0fc13 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [6347454] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_kubic_stable 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:07:53 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347454/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347454/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6d987e88cf644658b0f0c7f17b0b357b Command failed on smithi017 with status 5: 'sudo systemctl stop ceph-65bb1bbc-0140-11ec-8c24-001a4aab830c@mon.smithi017' [6347458] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:26:18 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347458/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347458/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e5136d551e0d456a8f2a8198a5406a87 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'mkdir $TESTDIR/archive/ostest && cd $TESTDIR/archive/ostest && ulimit -Sn 16384 && CEPH_ARGS="--no-log-to-stderr --log-file $TESTDIR/archive/ceph_test_objectstore.log --debug-bluestore 20" ceph_test_objectstore --gtest_filter=*/2:-*SyntheticMatrixC* --gtest_catch_exceptions=0\'' [6347460] rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:11:40 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347460/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347460/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7679f111a0cf4627ad8b191910410468 Command failed on smithi032 with status 5: 'sudo systemctl stop ceph-5ef2598e-0141-11ec-8c24-001a4aab830c@mon.a' [6347466] rados/dashboard/{centos_8.2_kubic_stable debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} tasks/e2e} ----------------------------------------------------------------- time: 00:12:11 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347466/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347466/ sentry: https://sentry.ceph.com/organizations/ceph/?query=78d1acf5f8104cb698967f094cb231fc Command failed on smithi149 with status 5: 'sudo systemctl stop ceph-725021c8-0141-11ec-8c24-001a4aab830c@mon.a' [6347504] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:19:17 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347504/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347504/ sentry: https://sentry.ceph.com/organizations/ceph/?query=065f76f87f96452686f9f69fa1570a29 Command failed (workunit test cls/test_cls_rgw.sh) on smithi093 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=53b16a841493c8dd0aa26936b0cc2246dfc0fc13 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh' [6347506] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_8.stream}} ----------------------------------------------------------------- time: 00:12:39 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347506/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347506/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0eaf328f303345bc94972dc949ba4733 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'mkdir $TESTDIR/archive/ostest && cd $TESTDIR/archive/ostest && ulimit -Sn 16384 && CEPH_ARGS="--no-log-to-stderr --log-file $TESTDIR/archive/ceph_test_objectstore.log --debug-bluestore 20" ceph_test_objectstore --gtest_filter=*SyntheticMatrixC*/2 --gtest_catch_exceptions=0\'' [6347542] rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:08:24 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347542/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347542/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ffd05131052f4fdcb0b2350d41c66ec7 Command failed on smithi042 with status 5: 'sudo systemctl stop ceph-85611f6c-0144-11ec-8c24-001a4aab830c@mon.a' [6347564] rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:08:41 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347564/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347564/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6de67f076c0c47bc9c8316519e71f2f0 Command failed on smithi074 with status 5: 'sudo systemctl stop ceph-2de4c062-0145-11ec-8c24-001a4aab830c@mon.a' [6347588] rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:08:16 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347588/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347588/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0b6c22788f044ad3b86976413d63939a Command failed on smithi197 with status 5: 'sudo systemctl stop ceph-4d6301b4-0146-11ec-8c24-001a4aab830c@mon.a' [6347609] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} tasks/rados_cls_all} ----------------------------------------------------------------- time: 00:15:49 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347609/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347609/ sentry: https://sentry.ceph.com/organizations/ceph/?query=25d535b0910f40aaa999ddcdaf26e59f Command failed (workunit test cls/test_cls_rgw.sh) on smithi032 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=53b16a841493c8dd0aa26936b0cc2246dfc0fc13 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh' [6347614] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_kubic_stable 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:05:26 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347614/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347614/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4e4f21008f5e490ba90daea7490f74b8 Command failed on smithi148 with status 5: 'sudo systemctl stop ceph-69ffd422-0147-11ec-8c24-001a4aab830c@mon.smithi148' [6347627] rados/upgrade/parallel/{0-distro$/{centos_8.3_container_tools_3.0} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 00:35:50 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347627/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347627/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f7b2d61c1e6d4da4b7858e28f99d9209 Command failed (workunit test cls/test_cls_rgw.sh) on smithi144 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=pacific TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh' [6347658] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:09:08 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347658/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347658/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c249d59abb6c48fbbdd168ebd93d06ba Command failed on smithi100 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:53b16a841493c8dd0aa26936b0cc2246dfc0fc13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 55a5a0ee-014a-11ec-8c24-001a4aab830c -- ceph mon dump -f json' [6347678] rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:08:11 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347678/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347678/ sentry: https://sentry.ceph.com/organizations/ceph/?query=322d6e3626c14e10a173882f338e235b Command failed on smithi131 with status 5: 'sudo systemctl stop ceph-5c3c36a6-014b-11ec-8c24-001a4aab830c@mon.a' [6347714] rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_adoption} ----------------------------------------------------------------- time: 00:08:51 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347714/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347714/ sentry: https://sentry.ceph.com/organizations/ceph/?query=60bc61e9d4df41cea073e478d76fba57 Command failed (workunit test cephadm/test_adoption.sh) on smithi064 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=53b16a841493c8dd0aa26936b0cc2246dfc0fc13 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [6347716] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/prometheus} ----------------------------------------------------------------- time: 00:21:11 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347716/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347716/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ee0cdcdf11934009b5b4ae69c513f4ee Test failure: test_standby (tasks.mgr.test_prometheus.TestPrometheus) [6347746] rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:08:38 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347746/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347746/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b16273b1db8344749a43f40d67cc7bd8 Command failed (workunit test cephadm/test_cephadm.sh) on smithi111 with status 126: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=53b16a841493c8dd0aa26936b0cc2246dfc0fc13 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [6347750] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:15:56 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347750/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347750/ sentry: https://sentry.ceph.com/organizations/ceph/?query=26506f88f84a4abdaa1a0a3861430e6a Command failed (workunit test cls/test_cls_rgw.sh) on smithi144 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=53b16a841493c8dd0aa26936b0cc2246dfc0fc13 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh' [6347771] rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:08:10 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347771/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347771/ sentry: https://sentry.ceph.com/organizations/ceph/?query=05f61b60eef94044861983300a4de1cb Command failed on smithi084 with status 5: 'sudo systemctl stop ceph-403eb32a-0150-11ec-8c24-001a4aab830c@mon.a' [6347785] rados/dashboard/{centos_8.2_kubic_stable debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} tasks/e2e} ----------------------------------------------------------------- time: 00:08:10 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347785/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347785/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e46ea1f321124d54b5dd2e70de2f56f7 Command failed on smithi104 with status 5: 'sudo systemctl stop ceph-1a49d360-0151-11ec-8c24-001a4aab830c@mon.a' [6347787] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 01:30:09 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347787/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347787/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3f27ef97ff16444585e2aad4a87d054e 'check osd count' reached maximum tries (90) after waiting for 900 seconds [6347865] rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:08:03 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347865/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347865/ sentry: https://sentry.ceph.com/organizations/ceph/?query=79b38e7a5f1148499243e4bf07c98508 Command failed on smithi151 with status 5: 'sudo systemctl stop ceph-c2f1a7c8-0155-11ec-8c24-001a4aab830c@mon.a' [6347889] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_kubic_stable 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:05:40 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347889/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347889/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ef15cda9cf1d4aab8690e83fab1f823a Command failed on smithi058 with status 5: 'sudo systemctl stop ceph- fa135d68-0156-11ec-8c24-001a4aab830c@mon.smithi058' [6347895] rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:08:12 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347895/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347895/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2bc84118ef55412e9cbbbcf52c8b4d6f Command failed on smithi053 with status 5: 'sudo systemctl stop ceph- add71998-0157-11ec-8c24-001a4aab830c@mon.a' [6347923] rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:08:22 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347923/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347923/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6d68e67807514a27a0774500a1e56b66 Command failed on smithi058 with status 5: 'sudo systemctl stop ceph-0c7865c8-0159-11ec-8c24-001a4aab830c@mon.a' [6347941] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:08:46 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347941/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347941/ sentry: https://sentry.ceph.com/organizations/ceph/?query=80580b4b1ce141688c3c231a866e697c Command failed on smithi168 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:53b16a841493c8dd0aa26936b0cc2246dfc0fc13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 306b391e-015a-11ec-8c24-001a4aab830c -- ceph mon dump -f json' [6347945] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/calico rook/1.7.0} ----------------------------------------------------------------- time: 02:53:54 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347945/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347945/ sentry: https://sentry.ceph.com/organizations/ceph/?query=30334321e7644ab9a6b0bbfd40bd722f timeout expired in wait_for_all_osds_up [6347949] rados/upgrade/parallel/{0-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 00:39:58 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347949/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347949/ sentry: https://sentry.ceph.com/organizations/ceph/?query=28722e03d6aa4e7ba058bcfe45ff2297 Command failed (workunit test cls/test_cls_rgw.sh) on smithi103 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=pacific TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh' [6347951] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 04:35:20 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347951/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347951/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d620d8ac537a49c78d4de0be6d3c3718 Command failed (workunit test cls/test_cls_rgw.sh) on smithi105 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=53b16a841493c8dd0aa26936b0cc2246dfc0fc13 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh' [6347993] rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:08:06 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347993/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347993/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e8bb9987cbff4898be06cb52be54d534 Command failed on smithi096 with status 5: 'sudo systemctl stop ceph- fb840b64-015d-11ec-8c24-001a4aab830c@mon.a' Dead ================================================================= [6347706] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347706/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347706/ hit max job timeout [6347929] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347929/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347929/ hit max job timeout Pass ================================================================= [6347427] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:16 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347427/ [6347428] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} time: 00:24:42 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347428/ [6347429] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:24:05 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347429/ [6347430] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream}} time: 00:10:57 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347430/ [6347431] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8.stream}} time: 00:28:26 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347431/ [6347432] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/client-keyring 3-final} time: 00:16:31 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347432/ [6347433] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8.stream}} time: 00:10:39 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347433/ [6347434] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-agent-small} time: 00:17:33 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347434/ [6347435] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:24:19 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347435/ [6347436] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/iscsi 3-final} time: 00:19:34 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347436/ [6347437] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:13:29 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347437/ [6347438] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8.stream} tasks/crash} time: 00:16:11 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347438/ [6347439] rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/osd-backfill} time: 04:24:06 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347439/ [6347440] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:32:49 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347440/ [6347441] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:39:41 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347441/ [6347442] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:27:22 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347442/ [6347443] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} time: 00:11:30 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347443/ [6347445] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:22:20 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347445/ [6347446] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:24:39 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347446/ [6347447] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:13:15 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347447/ [6347448] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream}} time: 00:16:01 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347448/ [6347449] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} tasks/mon_clock_no_skews} time: 00:11:42 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347449/ [6347450] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/mirror 3-final} time: 00:16:51 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347450/ [6347451] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} time: 00:35:19 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347451/ [6347452] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:56 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347452/ [6347453] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/one workloads/rados_5925} time: 00:14:03 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347453/ [6347455] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} time: 01:10:44 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347455/ [6347456] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:21:43 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347456/ [6347457] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:29:43 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347457/ [6347459] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:21 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347459/ [6347461] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:32:58 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347461/ [6347462] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:11 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347462/ [6347463] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:33:24 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347463/ [6347464] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:14:22 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347464/ [6347465] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingress-rgw 3-final} time: 00:22:11 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347465/ [6347467] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} time: 00:32:43 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347467/ [6347468] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-snaps} time: 00:32:01 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347468/ [6347470] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:38:55 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347470/ [6347472] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:14:35 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347472/ [6347474] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:12:59 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347474/ [6347475] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8.stream} tasks/failover} time: 00:18:59 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347475/ [6347476] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:48 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347476/ [6347478] rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_cephadm_repos} time: 00:07:09 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347478/ [6347480] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:14:19 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347480/ [6347481] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:39:51 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347481/ [6347483] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:33:07 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347483/ [6347485] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache} time: 00:12:41 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347485/ [6347487] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:09:38 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347487/ [6347489] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/nfs-ingress 3-final} time: 00:19:46 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347489/ [6347491] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:08:08 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347491/ [6347494] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:13:42 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347494/ [6347496] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream}} time: 00:13:11 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347496/ [6347497] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/dedup-io-mixed} time: 00:17:32 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347497/ [6347500] rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:17:02 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347500/ [6347502] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/sync-many workloads/rados_api_tests} time: 00:32:49 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347502/ [6347508] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/connectivity} time: 00:31:37 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347508/ [6347510] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:18:01 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347510/ [6347512] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:11:05 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347512/ [6347514] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:40 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347514/ [6347516] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:31:24 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347516/ [6347518] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:41:15 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347518/ [6347520] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-snaps} time: 00:24:38 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347520/ [6347522] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:59 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347522/ [6347524] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} time: 00:16:18 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347524/ [6347526] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:24:47 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347526/ [6347528] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:21:54 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347528/ [6347530] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:29:57 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347530/ [6347532] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:26:24 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347532/ [6347534] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream}} time: 00:51:17 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347534/ [6347536] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingress2 3-final} time: 00:20:45 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347536/ [6347538] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8.stream} tasks/insights} time: 00:15:06 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347538/ [6347540] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:36:24 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347540/ [6347545] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:30:15 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347545/ [6347547] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8.stream}} time: 00:19:32 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347547/ [6347549] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream}} time: 00:21:27 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347549/ [6347552] rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub} time: 02:43:29 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347552/ [6347553] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} tasks/mon_recovery} time: 00:15:35 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347553/ [6347554] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/nfs 3-final} time: 00:14:31 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347554/ [6347556] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:12:36 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347556/ [6347558] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:23:53 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347558/ [6347560] rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{centos_8.stream}} time: 00:32:28 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347560/ [6347562] rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:06:54 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347562/ [6347566] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:59 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347566/ [6347568] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:39:46 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347568/ [6347570] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:25:27 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347570/ [6347572] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} time: 00:41:41 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347572/ [6347574] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:22:44 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347574/ [6347576] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:04 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347576/ [6347578] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs2 3-final} time: 00:16:26 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347578/ [6347580] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:02:17 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347580/ [6347582] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:40:04 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347582/ [6347584] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:10:10 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347584/ [6347586] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:51:52 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347586/ [6347591] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:26:44 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347591/ [6347593] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:27:28 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347593/ [6347594] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/redirect} time: 00:14:33 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347594/ [6347595] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:09:30 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347595/ [6347597] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/rgw-ingress 3-final} time: 00:17:25 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347597/ [6347599] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:19:30 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347599/ [6347601] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:20:00 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347601/ [6347603] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:11:04 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347603/ [6347604] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:04 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347604/ [6347606] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream}} time: 00:31:18 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347606/ [6347607] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/rgw 3-final} time: 00:17:46 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347607/ [6347608] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:24:26 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347608/ [6347610] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} tasks/mon_recovery} time: 00:23:45 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347610/ [6347612] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:19:21 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347612/ [6347616] rados/dashboard/{centos_8.2_kubic_stable debug/mgr mon_election/classic random-objectstore$/{filestore-xfs} tasks/dashboard} time: 01:12:01 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347616/ [6347618] rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8.stream}} time: 00:10:00 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347618/ [6347620] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} time: 00:11:41 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347620/ [6347622] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.7.0} time: 00:32:18 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347622/ [6347623] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8.stream}} time: 00:18:52 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347623/ [6347625] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c} time: 00:10:56 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347625/ [6347629] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:25:58 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347629/ [6347631] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:14:44 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347631/ [6347633] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:37:22 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347633/ [6347635] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:23:40 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347635/ [6347637] rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.3_container_tools_3.0} 2-node-mgr orchestrator_cli} time: 00:14:27 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347637/ [6347639] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:14 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347639/ [6347641] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:10:28 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347641/ [6347642] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:49 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347642/ [6347644] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:37 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347644/ [6347646] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:10:46 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347646/ [6347648] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:17:27 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347648/ [6347650] rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:14:32 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347650/ [6347652] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/progress} time: 00:29:23 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347652/ [6347654] rados/singleton/{all/random-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:19:47 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347654/ [6347656] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:28:51 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347656/ [6347660] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:22:33 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347660/ [6347662] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:58 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347662/ [6347664] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-balanced} time: 00:19:21 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347664/ [6347666] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:16:07 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347666/ [6347668] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:35 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347668/ [6347670] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.3_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:11:46 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347670/ [6347672] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:26:36 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347672/ [6347674] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-localized} time: 00:19:25 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347674/ [6347676] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:09 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347676/ [6347680] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:11:38 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347680/ [6347682] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:08:04 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347682/ [6347684] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:09:26 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347684/ [6347686] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:54:03 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347686/ [6347688] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/classic} time: 00:27:19 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347688/ [6347690] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_workunits} time: 00:37:45 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347690/ [6347692] rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/crush} time: 00:21:31 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347692/ [6347694] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects} time: 00:19:44 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347694/ [6347696] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:34:48 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347696/ [6347698] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:59:50 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347698/ [6347700] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:31 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347700/ [6347702] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8.stream}} time: 00:08:57 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347702/ [6347704] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:35:33 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347704/ [6347708] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:07:11 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347708/ [6347710] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} time: 00:30:23 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347710/ [6347712] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:15:55 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347712/ [6347718] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:34 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347718/ [6347720] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:39:07 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347720/ [6347722] rados/singleton/{all/test-crash mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:19:36 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347722/ [6347724] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/client-keyring 3-final} time: 00:16:43 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347724/ [6347726] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} time: 00:27:35 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347726/ [6347728] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:10:30 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347728/ [6347730] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:32 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347730/ [6347732] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:37 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347732/ [6347734] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/iscsi 3-final} time: 00:14:19 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347734/ [6347736] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:08:11 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347736/ [6347738] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:16:41 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347738/ [6347740] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:30:31 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347740/ [6347742] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:03 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347742/ [6347744] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:20:11 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347744/ [6347748] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:15 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347748/ [6347752] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/one workloads/snaps-few-objects} time: 00:36:04 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347752/ [6347754] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} time: 00:13:43 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347754/ [6347756] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/mirror 3-final} time: 00:16:17 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347756/ [6347758] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:14 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347758/ [6347760] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 01:18:17 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347760/ [6347762] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_striper} time: 00:08:47 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347762/ [6347764] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:41:24 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347764/ [6347766] rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/erasure-code} time: 01:28:01 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347766/ [6347768] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:34 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347768/ [6347773] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:55 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347773/ [6347775] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/workunits} time: 00:18:50 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347775/ [6347777] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:38:49 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347777/ [6347779] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:10:19 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347779/ [6347781] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream}} time: 00:33:34 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347781/ [6347783] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/nfs-ingress-rgw 3-final} time: 00:15:36 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347783/ [6347789] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 01:22:07 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347789/ [6347791] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} time: 01:23:37 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347791/ [6347793] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} time: 00:10:58 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347793/ [6347795] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-agent-big} time: 00:26:42 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347795/ [6347797] rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_cephadm_repos} time: 00:06:20 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347797/ [6347799] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:17:51 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347799/ [6347801] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:07 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347801/ [6347803] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:25:30 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347803/ [6347805] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingress 3-final} time: 00:19:27 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347805/ [6347807] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:14:59 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347807/ [6347809] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-small} time: 00:12:06 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347809/ [6347811] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:18 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347811/ [6347813] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} tasks/rados_workunit_loadgen_big} time: 00:29:48 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347813/ [6347815] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:22:46 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347815/ [6347817] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:16:18 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347817/ [6347819] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:40:33 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347819/ [6347821] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:09:05 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347821/ [6347823] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/pool-create-delete} time: 00:25:13 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347823/ [6347825] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:30 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347825/ [6347827] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:34:32 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347827/ [6347829] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/connectivity} time: 00:29:00 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347829/ [6347831] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:14:58 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347831/ [6347833] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:18:33 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347833/ [6347835] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:41:19 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347835/ [6347837] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/crash} time: 00:12:05 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347837/ [6347839] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} time: 00:25:29 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347839/ [6347841] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:26:37 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347841/ [6347843] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:43:20 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347843/ [6347845] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:25:08 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347845/ [6347847] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} time: 00:34:46 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347847/ [6347849] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:30:17 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347849/ [6347851] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:22:30 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347851/ [6347853] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream}} time: 00:09:14 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347853/ [6347855] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/nfs-ingress2 3-final} time: 00:16:47 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347855/ [6347857] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8.stream}} time: 02:28:45 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347857/ [6347859] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/cache-snaps-balanced} time: 00:20:54 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347859/ [6347861] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:39:43 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347861/ [6347863] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} tasks/rados_workunit_loadgen_mix} time: 00:20:49 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347863/ [6347867] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:22:05 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347867/ [6347869] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:09:23 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347869/ [6347871] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:18:27 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347871/ [6347873] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:18:28 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347873/ [6347875] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs 3-final} time: 00:16:35 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347875/ [6347877] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:25:37 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347877/ [6347879] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:21:11 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347879/ [6347881] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:24:30 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347881/ [6347883] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:10:24 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347883/ [6347885] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:21:32 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347885/ [6347887] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} time: 00:08:46 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347887/ [6347891] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:23 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347891/ [6347893] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache} time: 00:16:50 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347893/ [6347897] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{centos_8.stream} tasks/failover} time: 00:14:39 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347897/ [6347899] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:07 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347899/ [6347901] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream}} time: 00:10:18 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347901/ [6347903] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:41:57 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347903/ [6347905] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} time: 00:54:21 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347905/ [6347907] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/dedup-io-mixed} time: 00:11:45 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347907/ [6347909] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/nfs2 3-final} time: 00:14:23 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347909/ [6347911] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:31:32 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347911/ [6347913] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:12:22 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347913/ [6347915] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:33:01 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347915/ [6347917] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8.stream}} time: 00:08:40 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347917/ [6347919] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:31:16 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347919/ [6347921] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:19:35 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347921/ [6347925] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:36:31 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347925/ [6347927] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:21 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347927/ [6347931] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:35:29 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347931/ [6347933] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/rgw-ingress 3-final} time: 00:19:57 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347933/ [6347935] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:08:14 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347935/ [6347937] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 01:14:38 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347937/ [6347939] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:31:17 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347939/ [6347943] rados/dashboard/{centos_8.2_kubic_stable debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} tasks/dashboard} time: 01:12:53 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347943/ [6347947] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:15:37 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347947/ [6347953] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:22:02 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347953/ [6347955] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_api_tests} time: 00:36:47 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347955/ [6347957] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:09:43 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347957/ [6347959] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:17:34 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347959/ [6347961] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:05:36 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347961/ [6347963] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:43:13 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347963/ [6347965] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:11:22 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347965/ [6347967] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8.stream} tasks/insights} time: 00:15:09 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347967/ [6347969] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:59 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347969/ [6347971] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:56 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347971/ [6347973] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/basic 3-final} time: 00:16:11 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347973/ [6347975] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:35:56 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347975/ [6347977] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8.stream}} time: 00:14:32 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347977/ [6347979] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 01:21:37 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347979/ [6347981] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:36:02 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347981/ [6347983] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:34:20 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347983/ [6347985] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:13:34 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347985/ [6347987] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} time: 01:02:17 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347987/ [6347989] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:24 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347989/ [6347991] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:38:16 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347991/ [6347995] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/radosbench} time: 01:37:48 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347995/ [6347997] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream}} time: 01:02:35 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347997/ [6347999] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:12:43 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6347999/ [6348001] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8.stream}} time: 00:09:54 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6348001/ [6348003] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:13:30 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6348003/ [6348005] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/classic} time: 00:28:26 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6348005/ [6348007] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:14:30 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6348007/ [6348009] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect} time: 00:15:27 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6348009/ [6348011] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:06:20 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6348011/ [6348013] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:54 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6348013/ [6348015] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:11:23 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6348015/ [6348017] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:34:43 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6348017/ [6348019] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:51:33 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6348019/ [6348021] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:53 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6348021/ [6348023] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:38 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6348023/ [6348025] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:27:06 info: http://pulpito.ceph.com/yuriw-2021-08-19_22:38:10-rados-wip-yuri6-testing-2021-08-19-1332-distro-basic-smithi/6348025/