2021-10-18T19:58:53.301 INFO:root:teuthology version: 1.1.0-b35344e8 2021-10-18T19:58:53.302 INFO:teuthology.results:subset: '111/120000' 2021-10-18T19:58:53.303 INFO:teuthology.results:seed: '7199' 2021-10-19T03:17:30.944 INFO:root:teuthology version: 1.1.0-b35344e8 2021-10-19T03:17:32.168 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-10-19T15:17:43.943 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2021-10-19T15:18:20.868 INFO:scrape:Found 379 jobs 2021-10-19T15:18:25.568 INFO:scrape:Found 13 distinct failure reasons 2021-10-19T15:18:25.569 INFO:scrape:Dead: b'2021-10-19T14:40:19.242 DEBUG:teuthology.exit:Finished running handlers' 2021-10-19T15:18:25.570 INFO:scrape:2 jobs: ['6449645', '6449463'] 2021-10-19T15:18:25.570 INFO:scrape:suites intersection: ['cluster/{12-osds', 'mon_election/connectivity', 'msgr-failures/few', 'openstack}', 'rados', 'rados/thrash-erasure-code-big/{ceph', 'supported-random-distro$/{ubuntu_latest}', 'thrashosds-health', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}'] 2021-10-19T15:18:25.571 INFO:scrape:suites union: ['cluster/{12-osds', 'mon_election/connectivity', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/thrash-erasure-code-big/{ceph', 'recovery-overrides/{more-async-recovery}', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/mapgap', 'thrashers/pggrow', 'thrashosds-health', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}'] 2021-10-19T15:18:25.571 INFO:scrape: 2021-10-19T15:18:25.572 INFO:scrape:Failure: reached maximum tries (800) after waiting for 4800 seconds 2021-10-19T15:18:25.572 INFO:scrape:1 jobs: ['6449540'] 2021-10-19T15:18:25.573 INFO:scrape:suites: ['clusters/{fixed-2', 'fast/normal', 'mon_election/connectivity', 'msgr-failures/few', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{more-async-partial-recovery}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/fastread', 'thrashosds-health', 'workloads/ec-radosbench}'] 2021-10-19T15:18:25.573 INFO:scrape: 2021-10-19T15:18:25.574 INFO:scrape:Timeout 6h running clone.client.0/qa/workunits/rados/test.sh 2021-10-19T15:18:25.574 INFO:scrape:1 jobs: ['6449447'] 2021-10-19T15:18:25.575 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}'] 2021-10-19T15:18:25.575 INFO:scrape: 2021-10-19T15:18:25.576 INFO:scrape:Failure: Command failed on smithi112 with status 1: 'sudo kubeadm init --node-name smithi112 --token abcdef.l2z7q97bbc5u8598 --pod-network-cidr 10.251.120.0/21' 2021-10-19T15:18:25.576 INFO:scrape:3 jobs: ['6449539', '6449312', '6449657'] 2021-10-19T15:18:25.577 INFO:scrape:suites intersection: ['0-kubeadm', '1-rook', '3-final', 'k8s/1.21', 'net/calico'] 2021-10-19T15:18:25.577 INFO:scrape:suites union: ['0-kubeadm', '1-rook', '2-workload/none', '2-workload/radosbench', '3-final', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_18.04', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.6.2}', 'rook/master}'] 2021-10-19T15:18:25.577 INFO:scrape: 2021-10-19T15:18:25.578 INFO:scrape:Failure: Command failed (workunit test scrub/osd-recovery-scrub.sh) on smithi089 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=18e721a1df0667425a82130f8b2c7d5af09c22ac TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh' 2021-10-19T15:18:25.578 INFO:scrape:1 jobs: ['6449254'] 2021-10-19T15:18:25.579 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{rhel_8}', 'workloads/scrub}'] 2021-10-19T15:18:25.579 INFO:scrape: 2021-10-19T15:18:25.580 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/test_librbd.sh 2021-10-19T15:18:25.580 INFO:scrape:1 jobs: ['6449369'] 2021-10-19T15:18:25.581 INFO:scrape:suites: ['1-install/nautilus', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-octopus', '8-workload/{rbd-python', 'bluestore-bitmap', 'mon_election/classic', 'rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack', 'rbd-import-export', 'rbd_api}', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_18.04}'] 2021-10-19T15:18:25.581 INFO:scrape: 2021-10-19T15:18:25.582 INFO:scrape:Failure: Command failed (workunit test rados/test_python.sh) on smithi089 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=18e721a1df0667425a82130f8b2c7d5af09c22ac TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh' 2021-10-19T15:18:25.582 INFO:scrape:1 jobs: ['6449417'] 2021-10-19T15:18:25.582 INFO:scrape:suites: ['clusters/{fixed-2', 'mon_election/connectivity', 'msgr-failures/many', 'msgr/async', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/basic/{ceph', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rados_python}'] 2021-10-19T15:18:25.583 INFO:scrape: 2021-10-19T15:18:25.583 INFO:scrape:Failure: Test failure: test_diskprediction_local (tasks.mgr.test_module_selftest.TestModuleSelftest) 2021-10-19T15:18:25.584 INFO:scrape:1 jobs: ['6449679'] 2021-10-19T15:18:25.584 INFO:scrape:suites: ['debug/mgr', 'mon_election/classic', 'objectstore/bluestore-comp-snappy', 'rados/mgr/{clusters/{2-node-mgr}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/module_selftest}'] 2021-10-19T15:18:25.585 INFO:scrape: 2021-10-19T15:18:25.585 INFO:scrape:Failure: Found coredumps on ubuntu@smithi112.front.sepia.ceph.com 2021-10-19T15:18:25.586 INFO:scrape:1 jobs: ['6449379'] 2021-10-19T15:18:25.586 INFO:scrape:suites: ['1-bootstrap/16.2.4', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0'] 2021-10-19T15:18:25.586 INFO:scrape: 2021-10-19T15:18:25.587 INFO:scrape:Dead: b'2021-10-19T15:18:23.725 INFO:teuthology.orchestra.run.smithi163.stdout:55336 16 3929 3913 0.282812 0 - 0.084699' 2021-10-19T15:18:25.587 INFO:scrape:1 jobs: ['6449399'] 2021-10-19T15:18:25.588 INFO:scrape:suites: ['debug/mgr', 'mon_election/classic', 'objectstore/bluestore-hybrid', 'rados/mgr/{clusters/{2-node-mgr}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/progress}'] 2021-10-19T15:18:25.588 INFO:scrape: 2021-10-19T15:18:25.589 INFO:scrape:Failure: Command failed on smithi103 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:18e721a1df0667425a82130f8b2c7d5af09c22ac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a96bf738-3088-11ec-8c28-001a4aab830c -- ceph mon dump -f json' 2021-10-19T15:18:25.589 INFO:scrape:2 jobs: ['6449667', '6449529'] 2021-10-19T15:18:25.589 INFO:scrape:suites intersection: ['1-start'] 2021-10-19T15:18:25.590 INFO:scrape:suites union: ['1-start', '2-services/nfs', '2-thrash', '3-final}', '3-tasks/small-objects', 'fixed-2', 'msgr/async', 'rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0', 'rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0', 'root}'] 2021-10-19T15:18:25.590 INFO:scrape: 2021-10-19T15:18:25.591 INFO:scrape:Failure: Command failed (workunit test mon/crush_ops.sh) on smithi117 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=18e721a1df0667425a82130f8b2c7d5af09c22ac TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/crush_ops.sh' 2021-10-19T15:18:25.591 INFO:scrape:1 jobs: ['6449712'] 2021-10-19T15:18:25.592 INFO:scrape:suites: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/mon-delay', 'msgr/async', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/one', 'workloads/rados_mon_workunits}'] 2021-10-19T15:18:25.592 INFO:scrape: 2021-10-19T15:18:25.593 INFO:scrape:Failure: Command failed on smithi084 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2021-10-19T15:18:25.593 INFO:scrape:1 jobs: ['6449359'] 2021-10-19T15:18:25.593 INFO:scrape:suites: ['clusters/{2-node-mgr}', 'debug/mgr', 'mon_election/classic', 'rados/dashboard/{centos_8.2_container_tools_3.0', 'random-objectstore$/{bluestore-stupid}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/dashboard}'] 2021-10-19T15:18:25.594 INFO:scrape: 2021-10-19T15:18:25.607 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/ failed: 14 dead: 1 running: 2 waiting: 0 queued: 0 passed: 362 Fail ================================================================= [6449254] rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub} ----------------------------------------------------------------- time: 00:21:08 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449254/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449254/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4ed1d2ddd3f849abaf4ee8ebd2a22276 Command failed (workunit test scrub/osd-recovery-scrub.sh) on smithi089 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=18e721a1df0667425a82130f8b2c7d5af09c22ac TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery- scrub.sh' [6449312] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:06:24 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449312/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449312/ sentry: https://sentry.ceph.com/organizations/ceph/?query=adb584c40ad54ea4b997f933768f0e3f Command failed on smithi109 with status 1: 'sudo kubeadm init --node-name smithi109 --token abcdef.n1kk5rrckdz4x40e --pod-network-cidr 10.251.96.0/21' [6449359] rados/dashboard/{centos_8.2_container_tools_3.0 clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 00:03:44 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449359/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449359/ sentry: https://sentry.ceph.com/organizations/ceph/?query=370d81444aca4f4e9ccdcdc7d9add55a Command failed on smithi084 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6449369] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 05:23:41 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449369/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449369/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9f730acf16d7402e94a20701180c56ff Command failed (workunit test rbd/test_librbd.sh) on smithi064 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=nautilus TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' [6449379] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:28:10 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449379/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449379/ Found coredumps on ubuntu@smithi112.front.sepia.ceph.com [6449417] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} ----------------------------------------------------------------- time: 00:13:40 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449417/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449417/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fe82724ab7fd4bd3b6395a8c136833a2 Command failed (workunit test rados/test_python.sh) on smithi089 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=18e721a1df0667425a82130f8b2c7d5af09c22ac TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh' [6449447] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 06:26:14 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449447/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449447/ sentry: https://sentry.ceph.com/organizations/ceph/?query=99622c959a814147a040b60c7f9ee7fb Command failed (workunit test rados/test.sh) on smithi109 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=18e721a1df0667425a82130f8b2c7d5af09c22ac TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [6449529] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:11:42 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449529/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449529/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8c9631492a0f4a0786fd695309a84c63 Command failed on smithi152 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:18e721a1df0667425a82130f8b2c7d5af09c22ac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be949c9e-307b-11ec-8c28-001a4aab830c -- ceph mon dump -f json' [6449539] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.6.2} ----------------------------------------------------------------- time: 00:06:49 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449539/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449539/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a2d9626fae4246ceb635275387fae061 Command failed on smithi112 with status 1: 'sudo kubeadm init --node-name smithi112 --token abcdef.l2z7q97bbc5u8598 --pod-network-cidr 10.251.120.0/21' [6449540] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench} ----------------------------------------------------------------- time: 02:17:52 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449540/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449540/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a86fce5b35564f15beebb07cda54b944 reached maximum tries (800) after waiting for 4800 seconds [6449657] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:06:53 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449657/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449657/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8c2c361aa7854807ac59e880216191a5 Command failed on smithi018 with status 1: 'sudo kubeadm init --node-name smithi018 --token abcdef.ovowbtv62ht0bu3p --pod-network-cidr 10.248.136.0/21' [6449667] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:08:48 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449667/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449667/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aeab5949d3424c6796238463daa93038 Command failed on smithi103 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:18e721a1df0667425a82130f8b2c7d5af09c22ac shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a96bf738-3088-11ec-8c28-001a4aab830c -- ceph mon dump -f json' [6449679] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/module_selftest} ----------------------------------------------------------------- time: 00:09:59 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449679/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449679/ sentry: https://sentry.ceph.com/organizations/ceph/?query=22ae9d2ef85e4563820f0162d9d09c4e Test failure: test_diskprediction_local (tasks.mgr.test_module_selftest.TestModuleSelftest) [6449712] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 00:13:43 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449712/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449712/ sentry: https://sentry.ceph.com/organizations/ceph/?query=feab890a727a4f4aa74cc6356ee424ab Command failed (workunit test mon/crush_ops.sh) on smithi117 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=18e721a1df0667425a82130f8b2c7d5af09c22ac TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/crush_ops.sh' Dead ================================================================= [6449645] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449645/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449645/ hit max job timeout Running ================================================================= [6449399] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/progress} info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449399/ [6449463] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449463/ Pass ================================================================= [6449153] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:14 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449153/ [6449157] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:51 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449157/ [6449159] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:01 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449159/ [6449161] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/client-keyring 3-final} time: 00:16:26 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449161/ [6449163] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps-balanced} time: 00:22:22 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449163/ [6449165] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:30:48 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449165/ [6449167] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_orch_cli} time: 00:13:46 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449167/ [6449169] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:10:05 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449169/ [6449171] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4M_seq_read} time: 00:10:48 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449171/ [6449172] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:27:17 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449172/ [6449174] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:18:39 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449174/ [6449175] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:14:21 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449175/ [6449177] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/iscsi 3-final} time: 00:14:41 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449177/ [6449179] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:11:50 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449179/ [6449181] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:23:51 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449181/ [6449183] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:04 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449183/ [6449185] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:34:07 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449185/ [6449187] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:24:14 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449187/ [6449189] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:44 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449189/ [6449191] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:27:41 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449191/ [6449193] rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:14:32 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449193/ [6449195] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} time: 00:33:59 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449195/ [6449197] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:13:33 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449197/ [6449199] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:52:05 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449199/ [6449201] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache} time: 00:24:12 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449201/ [6449203] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:18:38 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449203/ [6449205] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:23:58 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449205/ [6449207] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:09:26 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449207/ [6449209] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/classic} time: 00:30:46 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449209/ [6449211] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_adoption} time: 00:10:41 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449211/ [6449213] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/radosbench_4M_write} time: 00:09:21 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449213/ [6449215] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_api_tests} time: 00:37:53 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449215/ [6449217] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep} time: 00:15:48 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449217/ [6449219] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/mirror 3-final} time: 00:15:41 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449219/ [6449221] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} time: 00:24:07 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449221/ [6449223] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:16:04 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449223/ [6449225] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:39:08 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449225/ [6449227] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:51 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449227/ [6449229] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:56:02 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449229/ [6449231] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingress-rgw 3-final} time: 00:19:37 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449231/ [6449234] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:21:34 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449234/ [6449236] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/libcephsqlite} time: 00:17:06 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449236/ [6449238] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_cephadm} time: 00:15:24 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449238/ [6449240] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/nfs-ingress 3-final} time: 00:16:29 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449240/ [6449242] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/rados_api_tests} time: 00:25:11 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449242/ [6449244] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:34:35 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449244/ [6449246] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:27:54 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449246/ [6449248] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:48:46 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449248/ [6449250] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:29:16 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449250/ [6449252] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:11:58 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449252/ [6449256] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:16:09 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449256/ [6449258] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:30:52 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449258/ [6449260] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:36:12 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449260/ [6449262] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_omap_write} time: 00:28:06 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449262/ [6449264] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 01:00:43 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449264/ [6449266] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:12:02 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449266/ [6449268] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:16:37 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449268/ [6449270] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:22:49 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449270/ [6449272] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/nfs-ingress2 3-final} time: 00:19:32 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449272/ [6449274] rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}} time: 05:02:55 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449274/ [6449276] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:25:44 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449276/ [6449278] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_cephadm_repos} time: 00:06:53 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449278/ [6449280] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:23:48 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449280/ [6449282] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/radosbench} time: 01:44:29 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449282/ [6449284] rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:09:04 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449284/ [6449286] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:18 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449286/ [6449288] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/connectivity} time: 00:29:47 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449288/ [6449290] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:40:20 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449290/ [6449292] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:30:01 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449292/ [6449294] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} time: 00:30:47 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449294/ [6449296] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:35:59 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449296/ [6449298] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs 3-final} time: 00:17:32 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449298/ [6449300] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:22:27 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449300/ [6449302] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:26:41 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449302/ [6449304] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:39 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449304/ [6449306] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:27:27 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449306/ [6449308] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/sample_fio} time: 00:12:41 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449308/ [6449310] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_nfs} time: 00:21:49 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449310/ [6449314] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:09:44 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449314/ [6449317] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:43:07 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449317/ [6449319] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/nfs2 3-final} time: 00:14:17 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449319/ [6449321] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:34:48 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449321/ [6449323] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:16:49 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449323/ [6449325] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:39:31 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449325/ [6449327] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:36:26 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449327/ [6449329] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:13:28 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449329/ [6449331] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:10:09 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449331/ [6449333] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/rgw-ingress 3-final} time: 00:19:38 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449333/ [6449335] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:11 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449335/ [6449337] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:51 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449337/ [6449339] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:44:10 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449339/ [6449341] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:31:26 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449341/ [6449343] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_orch_cli} time: 00:12:52 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449343/ [6449345] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_set_object} time: 00:10:49 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449345/ [6449347] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:16:32 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449347/ [6449349] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:21:39 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449349/ [6449351] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/rgw 3-final} time: 00:19:03 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449351/ [6449353] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:08:45 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449353/ [6449355] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/sample_radosbench} time: 00:10:25 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449355/ [6449357] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:34:58 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449357/ [6449361] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:19:49 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449361/ [6449363] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:23:42 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449363/ [6449365] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:29:25 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449365/ [6449367] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} time: 00:22:13 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449367/ [6449371] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:20:35 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449371/ [6449373] rados/cephadm/dashboard/{0-distro/centos_8.2_container_tools_3.0 task/test_e2e} time: 00:20:32 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449373/ [6449375] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:26:56 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449375/ [6449377] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:22:36 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449377/ [6449381] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:27:56 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449381/ [6449383] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:54 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449383/ [6449385] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:22:57 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449385/ [6449387] rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.3_container_tools_3.0} 2-node-mgr orchestrator_cli} time: 00:14:15 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449387/ [6449389] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:20:28 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449389/ [6449391] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:20:56 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449391/ [6449393] rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:14:11 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449393/ [6449395] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/basic 3-final} time: 00:14:02 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449395/ [6449397] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:24:11 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449397/ [6449401] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.3_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:11:40 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449401/ [6449403] rados/singleton/{all/random-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:24:25 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449403/ [6449405] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:36:04 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449405/ [6449407] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:23:54 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449407/ [6449409] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:34:24 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449409/ [6449411] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:24:20 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449411/ [6449413] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/cosbench_64K_read_write} time: 00:18:27 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449413/ [6449415] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/classic} time: 00:27:01 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449415/ [6449419] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:22 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449419/ [6449421] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_adoption} time: 00:10:28 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449421/ [6449423] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:33:59 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449423/ [6449425] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:25:13 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449425/ [6449427] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:25:25 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449427/ [6449429] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/client-keyring 3-final} time: 00:15:39 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449429/ [6449431] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:11 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449431/ [6449433] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:08:03 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449433/ [6449435] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_cephadm} time: 00:15:14 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449435/ [6449437] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:20:10 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449437/ [6449439] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:29:46 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449439/ [6449441] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 01:11:31 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449441/ [6449443] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_workunits} time: 00:29:03 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449443/ [6449445] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} time: 00:13:03 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449445/ [6449449] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/iscsi 3-final} time: 00:16:40 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449449/ [6449451] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:29 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449451/ [6449453] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:03 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449453/ [6449455] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:15:50 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449455/ [6449457] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/cosbench_64K_write} time: 00:32:46 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449457/ [6449459] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:49:42 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449459/ [6449461] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:28:38 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449461/ [6449465] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:07:25 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449465/ [6449467] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/mirror 3-final} time: 00:14:27 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449467/ [6449469] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} time: 00:17:03 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449469/ [6449471] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:22:05 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449471/ [6449473] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} time: 00:50:21 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449473/ [6449475] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_cephadm_repos} time: 00:06:45 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449475/ [6449477] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:22 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449477/ [6449479] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:28:13 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449479/ [6449482] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:14:07 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449482/ [6449484] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:34:15 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449484/ [6449486] rados/singleton/{all/test-crash mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:10:23 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449486/ [6449488] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:25:21 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449488/ [6449490] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/nfs-ingress-rgw 3-final} time: 00:17:45 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449490/ [6449492] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:38:51 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449492/ [6449494] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/connectivity} time: 00:29:44 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449494/ [6449496] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:43 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449496/ [6449498] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_nfs} time: 00:22:28 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449498/ [6449500] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/fio_4K_rand_read} time: 00:11:11 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449500/ [6449502] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:25:45 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449502/ [6449504] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:30:09 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449504/ [6449506] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:07:01 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449506/ [6449508] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingress 3-final} time: 00:20:36 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449508/ [6449510] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:20 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449510/ [6449512] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:28:21 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449512/ [6449514] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:20:14 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449514/ [6449516] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:27:00 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449516/ [6449518] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:16:59 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449518/ [6449520] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects} time: 00:35:10 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449520/ [6449522] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:16:33 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449522/ [6449523] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:11 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449523/ [6449524] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 01:19:16 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449524/ [6449525] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:18:07 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449525/ [6449526] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_striper} time: 00:12:41 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449526/ [6449527] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:40:40 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449527/ [6449528] rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} time: 00:07:22 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449528/ [6449530] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:49 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449530/ [6449531] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/nfs-ingress2 3-final} time: 00:18:07 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449531/ [6449532] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:08:09 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449532/ [6449533] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:08:20 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449533/ [6449534] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_orch_cli} time: 00:13:30 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449534/ [6449535] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:55:21 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449535/ [6449536] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:39:27 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449536/ [6449537] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/fio_4K_rand_rw} time: 00:13:11 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449537/ [6449538] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/nfs 3-final} time: 00:16:00 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449538/ [6449541] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:43:37 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449541/ [6449542] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs2 3-final} time: 00:16:38 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449542/ [6449543] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:36 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449543/ [6449544] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 01:04:38 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449544/ [6449545] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:18:26 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449545/ [6449546] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:46 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449546/ [6449547] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:34:25 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449547/ [6449548] rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:14:04 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449548/ [6449549] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} time: 00:11:33 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449549/ [6449550] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:13:25 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449550/ [6449551] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:14:44 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449551/ [6449552] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:23:21 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449552/ [6449553] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} time: 00:32:42 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449553/ [6449554] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:37:58 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449554/ [6449555] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:12:31 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449555/ [6449556] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:22:51 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449556/ [6449557] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/classic} time: 00:29:16 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449557/ [6449558] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/fio_4M_rand_read} time: 00:09:35 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449558/ [6449559] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:30:49 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449559/ [6449560] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/pool-create-delete} time: 00:24:56 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449560/ [6449561] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_adoption} time: 00:10:28 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449561/ [6449562] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:29 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449562/ [6449563] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/rgw-ingress 3-final} time: 00:17:17 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449563/ [6449564] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:15:54 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449564/ [6449565] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:19:38 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449565/ [6449566] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:09:47 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449566/ [6449567] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:26:03 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449567/ [6449568] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:33:17 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449568/ [6449569] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/crash} time: 00:22:27 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449569/ [6449570] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:27:59 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449570/ [6449571] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:21:35 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449571/ [6449572] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_cephadm} time: 00:15:54 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449572/ [6449573] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:37:29 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449573/ [6449574] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/rgw 3-final} time: 00:17:16 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449574/ [6449575] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:18:54 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449575/ [6449576] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:29:01 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449576/ [6449577] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:33:44 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449577/ [6449578] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:35:31 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449578/ [6449579] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:06:44 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449579/ [6449580] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:27:56 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449580/ [6449581] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:15:54 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449581/ [6449582] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:52:38 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449582/ [6449583] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/fio_4M_rand_rw} time: 00:10:09 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449583/ [6449584] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} time: 00:19:52 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449584/ [6449585] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/basic 3-final} time: 00:16:55 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449585/ [6449586] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:27:01 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449586/ [6449587] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:07:03 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449587/ [6449588] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:28:27 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449588/ [6449589] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:33:20 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449589/ [6449590] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:18:25 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449590/ [6449591] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_cephadm_repos} time: 00:07:01 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449591/ [6449592] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/client-keyring 3-final} time: 00:14:48 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449592/ [6449593] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:22:39 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449593/ [6449594] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:23:29 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449594/ [6449595] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:32:04 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449595/ [6449596] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:08:46 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449596/ [6449597] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:22:34 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449597/ [6449598] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_5925} time: 00:10:34 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449598/ [6449599] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:19 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449599/ [6449600] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/connectivity} time: 00:26:59 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449600/ [6449601] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:47:29 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449601/ [6449602] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:12:20 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449602/ [6449603] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} time: 00:28:16 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449603/ [6449604] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:22:03 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449604/ [6449605] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/iscsi 3-final} time: 00:16:02 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449605/ [6449606] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/fio_4M_rand_write} time: 00:14:03 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449606/ [6449607] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache} time: 00:09:36 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449607/ [6449608] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:07:57 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449608/ [6449609] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_nfs} time: 00:21:55 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449609/ [6449610] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:42:12 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449610/ [6449611] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} time: 02:25:27 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449611/ [6449612] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:32:08 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449612/ [6449613] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:17:33 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449613/ [6449614] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:21:39 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449614/ [6449615] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:51:46 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449615/ [6449616] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:31:20 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449616/ [6449617] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/mirror 3-final} time: 00:17:15 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449617/ [6449618] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:27:39 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449618/ [6449619] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:09:51 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449619/ [6449620] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:25 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449620/ [6449621] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:11:58 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449621/ [6449622] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:29:34 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449622/ [6449623] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:36:11 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449623/ [6449624] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_orch_cli} time: 00:12:55 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449624/ [6449625] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/nfs-ingress-rgw 3-final} time: 00:15:35 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449625/ [6449626] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:07:57 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449626/ [6449627] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:31:38 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449627/ [6449628] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 01:15:57 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449628/ [6449629] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4K_rand_read} time: 00:12:05 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449629/ [6449630] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/nfs-ingress 3-final} time: 00:17:58 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449630/ [6449631] rados/dashboard/{centos_8.2_container_tools_3.0 clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:21:09 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449631/ [6449632] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:16:04 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449632/ [6449633] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} time: 02:59:13 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449633/ [6449634] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:35:17 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449634/ [6449635] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 02:19:36 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449635/ [6449636] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:05 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449636/ [6449637] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} time: 00:23:14 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449637/ [6449638] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:42:40 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449638/ [6449639] rados/cephadm/dashboard/{0-distro/centos_8.2_container_tools_3.0 task/test_e2e} time: 00:19:44 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449639/ [6449640] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:18:39 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449640/ [6449641] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:56:52 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449641/ [6449642] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:15:51 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449642/ [6449643] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:12:13 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449643/ [6449644] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:26:02 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449644/ [6449646] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:47 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449646/ [6449647] rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr orchestrator_cli} time: 00:11:47 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449647/ [6449648] rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:14:49 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449648/ [6449649] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 01:06:54 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449649/ [6449650] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench} time: 01:03:04 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449650/ [6449651] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:27:38 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449651/ [6449652] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:12:44 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449652/ [6449653] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:08:01 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449653/ [6449654] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/radosbench_4K_seq_read} time: 00:11:05 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449654/ [6449655] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:52 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449655/ [6449656] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:30:57 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449656/ [6449658] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/classic} time: 00:30:00 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449658/ [6449659] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:35:59 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449659/ [6449660] rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} time: 00:41:09 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449660/ [6449661] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 01:06:21 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449661/ [6449662] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_adoption} time: 00:10:23 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449662/ [6449663] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect} time: 00:15:50 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449663/ [6449664] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingress2 3-final} time: 00:21:40 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449664/ [6449665] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:20:07 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449665/ [6449666] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:22:51 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449666/ [6449668] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_cephadm} time: 00:15:29 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449668/ [6449669] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:15:11 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449669/ [6449670] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:19:18 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449670/ [6449671] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:18:38 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449671/ [6449672] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:48 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449672/ [6449673] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:11:08 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449673/ [6449674] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:25:46 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449674/ [6449675] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:54:00 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449675/ [6449676] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/nfs2 3-final} time: 00:15:35 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449676/ [6449677] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:33:29 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449677/ [6449678] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:59 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449678/ [6449680] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4M_rand_read} time: 00:10:51 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449680/ [6449681] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:15:56 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449681/ [6449682] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:21:48 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449682/ [6449683] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:10:49 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449683/ [6449684] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:36:28 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449684/ [6449685] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:12:43 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449685/ [6449686] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_cephadm_repos} time: 00:06:47 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449686/ [6449687] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/rgw-ingress 3-final} time: 00:21:04 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449687/ [6449688] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:46 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449688/ [6449689] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects} time: 00:21:48 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449689/ [6449690] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:36:01 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449690/ [6449691] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:13:28 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449691/ [6449692] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:13:54 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449692/ [6449693] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:26:16 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449693/ [6449694] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:23:17 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449694/ [6449695] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:20:18 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449695/ [6449696] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:33:11 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449696/ [6449697] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/connectivity} time: 00:29:59 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449697/ [6449698] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:14:29 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449698/ [6449699] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:21 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449699/ [6449700] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/rgw 3-final} time: 00:16:09 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449700/ [6449701] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4M_seq_read} time: 00:09:40 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449701/ [6449702] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:19:24 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449702/ [6449703] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_nfs} time: 00:22:10 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449703/ [6449704] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:20:57 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449704/ [6449705] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:06:49 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449705/ [6449706] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} time: 00:58:47 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449706/ [6449707] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:05 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449707/ [6449708] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:40:58 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449708/ [6449709] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:26:10 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449709/ [6449710] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} time: 01:05:55 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449710/ [6449711] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:20:02 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449711/ [6449713] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:17:48 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449713/ [6449714] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:20:41 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449714/ [6449715] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/progress} time: 00:19:14 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449715/ [6449716] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} time: 03:05:48 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449716/ [6449717] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:21:57 info: http://pulpito.ceph.com/yuriw-2021-10-18_19:04:28-rados-wip-yuri3-testing-2021-10-18-0907-pacific-distro-basic-smithi/6449717/