2022-01-19T02:10:37.456 INFO:root:teuthology version: 1.1.0-3ff86a5d 2022-01-19T02:10:37.459 INFO:teuthology.results:subset: '111/120000' 2022-01-19T02:10:37.460 INFO:teuthology.results:seed: '9183' 2022-01-19T07:07:31.206 INFO:root:teuthology version: 1.1.0-3ff86a5d 2022-01-19T07:07:31.235 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-01-19T13:19:07.188 INFO:teuthology.results:Tests finished! gathering results... 2022-01-19T13:19:44.968 INFO:scrape:Found 425 jobs 2022-01-19T13:19:51.647 INFO:scrape:Found 9 distinct failure reasons 2022-01-19T13:19:51.648 INFO:scrape:Failure: Command failed on smithi103 with status 126: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:2ee85db131350e9c92cb3a187d4a20a49524d846 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62baffa4-78f0-11ec-8c34-001a4aab830c -- ceph mon dump -f json' 2022-01-19T13:19:51.649 INFO:scrape:15 jobs: ['6625462', '6625088', '6625311', '6625419', '6625455', '6625210', '6625581', '6625268', '6625285', '6625019', '6625230', '6625336', '6625115', '6625379', '6625566'] 2022-01-19T13:19:51.650 INFO:scrape:suites intersection: [] 2022-01-19T13:19:51.650 INFO:scrape:suites union: ['0-nvme-loop', '1-install/luminous', '1-install/luminous-v1only', '1-install/mimic', '1-install/mimic-v1only', '1-install/nautilus', '1-install/nautilus-v1only', '1-install/nautilus-v2only', '1-install/octopus', '1-start', '2-services/nfs-ingress-rgw-bucket', '3-final}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'fixed-2', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'rados', 'rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'rados/cephadm/with-work/{0-distro/ubuntu_18.04', 'start', 'tasks/rados_api_tests}', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}'] 2022-01-19T13:19:51.651 INFO:scrape: 2022-01-19T13:19:51.651 INFO:scrape:Dead: b'2022-01-19T13:14:00.049 DEBUG:teuthology.exit:Finished running handlers' 2022-01-19T13:19:51.652 INFO:scrape:10 jobs: ['6625528', '6625157', '6625319', '6625286', '6625046', '6625387', '6625271', '6625525', '6625497', '6625427'] 2022-01-19T13:19:51.652 INFO:scrape:suites intersection: ['3-upgrade-with-workload'] 2022-01-19T13:19:51.653 INFO:scrape:suites union: ['1-bootstrap/16.2.4', '1-bootstrap/octopus', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-nfs', '3-upgrade-with-workload', '3-verify}', '4-final}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.3_container_tools_3.0', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools', 'roles', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-01-19T13:19:51.653 INFO:scrape: 2022-01-19T13:19:51.654 INFO:scrape:Failure: SSH connection to smithi184 was lost: 'uname -r' 2022-01-19T13:19:51.654 INFO:scrape:10 jobs: ['6625478', '6625356', '6625403', '6625495', '6625488', '6625571', '6625548', '6625394', '6625076', '6625521'] 2022-01-19T13:19:51.655 INFO:scrape:suites intersection: [] 2022-01-19T13:19:51.655 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-install/luminous', '1-install/mimic', '1-install/mimic-v1only', '1-install/nautilus', '1-install/nautilus-v1only', '1-rook', '1-start', '2-ops/repave-all}', '2-workload/radosbench', '3-final', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'cluster/3-node', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'distro/ubuntu_18.04', 'fixed-2', 'k8s/1.21', 'mode/packaged', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async-v2only', 'net/calico', 'rados', 'rados/cephadm/osds/{0-distro/ubuntu_18.04', 'rados/cephadm/smoke/{0-nvme-loop', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'rados/cephadm/with-work/{0-distro/ubuntu_18.04', 'rados/rook/smoke/{0-distro/ubuntu_18.04', 'rook/1.6.2}', 'start', 'start}', 'tasks/rados_python}', 'thrashers/careful', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}'] 2022-01-19T13:19:51.656 INFO:scrape: 2022-01-19T13:19:51.657 INFO:scrape:Failure: Command failed on smithi176 with status 251: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn' 2022-01-19T13:19:51.657 INFO:scrape:9 jobs: ['6625400', '6625512', '6625510', '6625299', '6625296', '6625022', '6625334', '6625079', '6625398'] 2022-01-19T13:19:51.657 INFO:scrape:suites intersection: [] 2022-01-19T13:19:51.658 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-ops/rm-zap-add}', '2-ops/rm-zap-flag}', '2-services/basic', '2-services/nfs-ingress-rgw-user', '2-services/nfs-ingress2', '2-services/rgw-ingress', '3-final}', 'distro/ubuntu_18.04', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/osds/{0-distro/ubuntu_18.04', 'rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04', 'rados/cephadm/smoke/{0-nvme-loop', 'start}'] 2022-01-19T13:19:51.659 INFO:scrape: 2022-01-19T13:19:51.659 INFO:scrape:Failure: [Errno 2] Cannot find file on the remote 'ubuntu@smithi017.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' 2022-01-19T13:19:51.660 INFO:scrape:2 jobs: ['6625440', '6625043'] 2022-01-19T13:19:51.660 INFO:scrape:suites intersection: ['0-kubeadm', '1-rook', '3-final', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}'] 2022-01-19T13:19:51.660 INFO:scrape:suites union: ['0-kubeadm', '1-rook', '2-workload/none', '2-workload/radosbench', '3-final', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}'] 2022-01-19T13:19:51.661 INFO:scrape: 2022-01-19T13:19:51.661 INFO:scrape:Failure: Command failed on smithi146 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:2ee85db131350e9c92cb3a187d4a20a49524d846 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d401da4e-78e5-11ec-8c34-001a4aab830c -- ceph orch daemon add osd smithi146:vg_nvme/lv_4' 2022-01-19T13:19:51.662 INFO:scrape:1 jobs: ['6625324'] 2022-01-19T13:19:51.662 INFO:scrape:suites: ['1-start', '2-services/rgw', '3-final}', 'rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_18.04}'] 2022-01-19T13:19:51.663 INFO:scrape: 2022-01-19T13:19:51.663 INFO:scrape:Failure: Found coredumps on ubuntu@smithi067.front.sepia.ceph.com 2022-01-19T13:19:51.664 INFO:scrape:1 jobs: ['6625357'] 2022-01-19T13:19:51.664 INFO:scrape:suites: ['1-bootstrap/16.2.5', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.3_container_tools_3.0'] 2022-01-19T13:19:51.665 INFO:scrape: 2022-01-19T13:19:51.665 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi160 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2ee85db131350e9c92cb3a187d4a20a49524d846 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2022-01-19T13:19:51.666 INFO:scrape:2 jobs: ['6625139', '6625421'] 2022-01-19T13:19:51.666 INFO:scrape:suites intersection: ['rados/cephadm/dashboard/{0-distro/centos_8.3_container_tools_3.0', 'task/test_e2e}'] 2022-01-19T13:19:51.667 INFO:scrape:suites union: ['rados/cephadm/dashboard/{0-distro/centos_8.3_container_tools_3.0', 'task/test_e2e}'] 2022-01-19T13:19:51.667 INFO:scrape: 2022-01-19T13:19:51.667 INFO:scrape:Failure: Command failed on smithi160 with status 1: 'sudo fuser -v /var/lib/dpkg/lock-frontend' 2022-01-19T13:19:51.668 INFO:scrape:1 jobs: ['6625406'] 2022-01-19T13:19:51.668 INFO:scrape:suites: ['mon_election/classic', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-comp-zlib', 'rados', 'rados/singleton/{all/dump-stuck', 'supported-random-distro$/{ubuntu_latest}}'] 2022-01-19T13:19:51.669 INFO:scrape: 2022-01-19T13:19:51.684 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/ failed: 31 dead: 20 running: 0 waiting: 0 queued: 0 passed: 374 Fail ================================================================= [6625019] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:09:08 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625019/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625019/ sentry: https://sentry.ceph.com/organizations/ceph/?query=46502c3770954335ade0b3dd273e0b48 Command failed on smithi118 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:2ee85db131350e9c92cb3a187d4a20a49524d846 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41024aae-78d0-11ec-8c34-001a4aab830c -- ceph orch daemon add osd smithi118:vg_nvme/lv_4' [6625022] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:03:21 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625022/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625022/ sentry: https://sentry.ceph.com/organizations/ceph/?query=39502e4ab9154903989451158fbdaf74 Command failed on smithi110 with status 251: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn' [6625043] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:05:58 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625043/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625043/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e8e3c7da0cfd49b8acc280e28345a338 [Errno 2] Cannot find file on the remote 'ubuntu@smithi120.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' [6625079] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:03:26 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625079/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625079/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c6e5fe1854ad4baf99a69697ecb085e7 Command failed on smithi035 with status 251: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn' [6625088] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:09:47 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625088/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625088/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cadd9f0ef1564deeb765d0f3b4e1b7a7 Command failed on smithi070 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:2ee85db131350e9c92cb3a187d4a20a49524d846 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8ad0cb50-78d6-11ec-8c34-001a4aab830c -- ceph orch daemon add osd smithi070:vg_nvme/lv_4' [6625115] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:09:07 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625115/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625115/ sentry: https://sentry.ceph.com/organizations/ceph/?query=caaac9316b8a4de8b76a5c558bb23f2d Command failed on smithi040 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:2ee85db131350e9c92cb3a187d4a20a49524d846 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 16641b62-78d8-11ec-8c34-001a4aab830c -- ceph orch daemon add osd smithi040:vg_nvme/lv_4' [6625139] rados/cephadm/dashboard/{0-distro/centos_8.3_container_tools_3.0 task/test_e2e} ----------------------------------------------------------------- time: 00:18:53 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625139/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625139/ sentry: https://sentry.ceph.com/organizations/ceph/?query=72f0adc7add94e92adc1b2a11b4c5a8e Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi160 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2ee85db131350e9c92cb3a187d4a20a49524d846 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [6625210] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:09:14 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625210/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625210/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ea6018445f5d4cb8823b95535a726268 Command failed on smithi052 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:2ee85db131350e9c92cb3a187d4a20a49524d846 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1addee88-78de-11ec-8c34-001a4aab830c -- ceph orch daemon add osd smithi052:vg_nvme/lv_4' [6625230] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:09:40 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625230/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625230/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1f99b2b27a344cb58545ce972a183363 Command failed on smithi062 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:2ee85db131350e9c92cb3a187d4a20a49524d846 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7362010-78de-11ec-8c34-001a4aab830c -- ceph orch daemon add osd smithi062:vg_nvme/lv_4' [6625268] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:09:30 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625268/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625268/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c69621db5ba74373a4c54fb0ec30aac1 Command failed on smithi029 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:2ee85db131350e9c92cb3a187d4a20a49524d846 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ccc6cc-78e1-11ec-8c34-001a4aab830c -- ceph orch daemon add osd smithi029:vg_nvme/lv_4' [6625285] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:08:59 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625285/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625285/ sentry: https://sentry.ceph.com/organizations/ceph/?query=69b7d4de8b0c41169ff761ca274ad3cb Command failed on smithi042 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:2ee85db131350e9c92cb3a187d4a20a49524d846 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90fa36d6-78e2-11ec-8c34-001a4aab830c -- ceph orch daemon add osd smithi042:vg_nvme/lv_4' [6625296] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:03:24 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625296/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625296/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f2d6b22454b64576a1eb672df9e45682 Command failed on smithi133 with status 251: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn' [6625299] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:03:23 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625299/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625299/ sentry: https://sentry.ceph.com/organizations/ceph/?query=14ba1d40edd34b9293a44bc85ff96486 Command failed on smithi055 with status 251: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn' [6625311] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:08:59 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625311/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625311/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ccdba5916f7e49dbb2d1fdac121054a0 Command failed on smithi042 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:2ee85db131350e9c92cb3a187d4a20a49524d846 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42af9554-78e5-11ec-8c34-001a4aab830c -- ceph orch daemon add osd smithi042:vg_nvme/lv_4' [6625324] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_18.04} 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:06:42 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625324/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625324/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0666aa2d62bd4a27af7c0d13d8342415 Command failed on smithi146 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:2ee85db131350e9c92cb3a187d4a20a49524d846 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d401da4e-78e5-11ec-8c34-001a4aab830c -- ceph orch daemon add osd smithi146:vg_nvme/lv_4' [6625334] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:03:24 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625334/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625334/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c8518cecdc3548cbadb4eea482763edf Command failed on smithi085 with status 251: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn' [6625336] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:08:53 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625336/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625336/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4461369db90542adb06eeef525aed6fe Command failed on smithi027 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:2ee85db131350e9c92cb3a187d4a20a49524d846 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b9275fe4-78e7-11ec-8c34-001a4aab830c -- ceph orch daemon add osd smithi027:vg_nvme/lv_4' [6625357] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.3_container_tools_3.0 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:27:29 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625357/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625357/ Found coredumps on ubuntu@smithi067.front.sepia.ceph.com [6625379] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:09:49 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625379/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625379/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2961481756294e1c81588b8d636bb102 Command failed on smithi027 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:2ee85db131350e9c92cb3a187d4a20a49524d846 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f40f322-78ea-11ec-8c34-001a4aab830c -- ceph orch daemon add osd smithi027:vg_nvme/lv_4' [6625398] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:03:21 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625398/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625398/ sentry: https://sentry.ceph.com/organizations/ceph/?query=556d29abef574a7b870c3921315c95d6 Command failed on smithi002 with status 251: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn' [6625400] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:03:25 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625400/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625400/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b8f6fd8f20734db5b773bfa8410f899b Command failed on smithi176 with status 251: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn' [6625406] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625406/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625406/ sentry: https://sentry.ceph.com/organizations/ceph/?query=964673942f2e4a76a017af681ea7d06e Command failed on smithi160 with status 1: 'sudo fuser -v /var/lib/dpkg/lock-frontend' [6625419] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:09:56 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625419/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625419/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8b87e5e5702847acbf4c9cf72bc46876 Command failed on smithi027 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:2ee85db131350e9c92cb3a187d4a20a49524d846 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8081c08e-78ed-11ec-8c34-001a4aab830c -- ceph orch daemon add osd smithi027:vg_nvme/lv_4' [6625421] rados/cephadm/dashboard/{0-distro/centos_8.3_container_tools_3.0 task/test_e2e} ----------------------------------------------------------------- time: 00:19:06 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625421/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625421/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aba69c310ae84acd8f55b34ef53c8c5c Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi096 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2ee85db131350e9c92cb3a187d4a20a49524d846 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [6625440] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:06:16 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625440/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625440/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8d981dbeb5fe489dae896bfc03e4f911 [Errno 2] Cannot find file on the remote 'ubuntu@smithi017.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' [6625455] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:08:56 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625455/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625455/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d51eb9c36a3b4ce2aa9f0e34be63cde0 Command failed on smithi100 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:2ee85db131350e9c92cb3a187d4a20a49524d846 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5aa35196-78ef-11ec-8c34-001a4aab830c -- ceph orch daemon add osd smithi100:vg_nvme/lv_4' [6625462] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:08:10 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625462/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625462/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ef001cba71ff4ecfbf288ad5115be374 Command failed on smithi103 with status 126: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:2ee85db131350e9c92cb3a187d4a20a49524d846 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62baffa4-78f0-11ec-8c34-001a4aab830c -- ceph mon dump -f json' [6625510] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:03:26 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625510/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625510/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e6499369911d423a9ac4e377e0ff6bf5 Command failed on smithi023 with status 251: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn' [6625512] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:03:26 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625512/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625512/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e4e1d1a323b24d02a0d0d88a6011bae4 Command failed on smithi119 with status 251: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn' [6625566] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:09:20 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625566/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625566/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d1939c5091c849f6862f9b7d56382c29 Command failed on smithi065 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:2ee85db131350e9c92cb3a187d4a20a49524d846 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4986ba3a-78f7-11ec-8c34-001a4aab830c -- ceph orch daemon add osd smithi065:vg_nvme/lv_4' [6625581] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:09:14 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625581/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625581/ sentry: https://sentry.ceph.com/organizations/ceph/?query=324fac91e968430dad5950faedfb155f Command failed on smithi066 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:2ee85db131350e9c92cb3a187d4a20a49524d846 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a243e49e-78f8-11ec-8c34-001a4aab830c -- ceph orch daemon add osd smithi066:vg_nvme/lv_4' Dead ================================================================= [6625046] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625046/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625046/ hit max job timeout [6625076] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625076/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625076/ sentry: https://sentry.ceph.com/organizations/ceph/?query=19745ffaaee645968a671c8dba7a2a33 SSH connection to smithi167 was lost: 'uname -r' [6625157] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.3_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625157/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625157/ hit max job timeout [6625271] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625271/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625271/ hit max job timeout [6625286] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.3_container_tools_3.0 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625286/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625286/ hit max job timeout [6625319] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625319/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625319/ hit max job timeout [6625356] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625356/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625356/ sentry: https://sentry.ceph.com/organizations/ceph/?query=50eccd30122745a4bbe7fd52cb93e239 SSH connection to smithi043 was lost: 'uname -r' [6625387] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625387/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625387/ hit max job timeout [6625394] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625394/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625394/ sentry: https://sentry.ceph.com/organizations/ceph/?query=44973e003220422882b2f5e17717e500 SSH connection to smithi043 was lost: 'uname -r' [6625403] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625403/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625403/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b72bf1aba78449bd97460a7ebe42810b SSH connection to smithi161 was lost: 'uname -r' [6625427] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.3_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625427/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625427/ hit max job timeout [6625478] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625478/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625478/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4a8b7aea6c8049a4990b96887704d3d3 SSH connection to smithi184 was lost: 'uname -r' [6625488] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/repave-all} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625488/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625488/ sentry: https://sentry.ceph.com/organizations/ceph/?query=16a080c179a045f5b37665426dda954f SSH connection to smithi006 was lost: 'uname -r' [6625495] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625495/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625495/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bf35915dc9524e0fb98cb3a64c806ac6 SSH connection to smithi159 was lost: 'uname -r' [6625497] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.3_container_tools_3.0 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625497/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625497/ hit max job timeout [6625521] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625521/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625521/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2b37aaa2a97643fba5aa3540bc0e417d SSH connection to smithi017 was lost: 'uname -r' [6625525] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625525/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625525/ hit max job timeout [6625528] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625528/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625528/ hit max job timeout [6625548] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625548/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625548/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4a7194b9c10c46e9b6e5eba526550905 SSH connection to smithi179 was lost: 'uname -r' [6625571] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625571/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625571/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0261eeff6a6a4d41958b466d2c0b1cbf SSH connection to smithi120 was lost: 'uname -r' Pass ================================================================= [6625003] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:29:23 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625003/ [6625005] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:51 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625005/ [6625007] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:40:23 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625007/ [6625010] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:30:25 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625010/ [6625013] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} time: 00:31:42 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625013/ [6625016] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:25:18 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625016/ [6625025] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:17 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625025/ [6625028] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:20:14 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625028/ [6625031] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:51:21 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625031/ [6625034] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:31:40 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625034/ [6625037] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:18:01 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625037/ [6625040] rados/singleton/{all/peer mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:06:58 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625040/ [6625049] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:29:04 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625049/ [6625052] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:34:09 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625052/ [6625055] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:33:12 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625055/ [6625058] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} time: 00:35:11 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625058/ [6625061] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:31:08 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625061/ [6625064] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_orch_cli} time: 00:14:03 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625064/ [6625067] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:11:41 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625067/ [6625070] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:11:41 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625070/ [6625073] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:10:12 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625073/ [6625082] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:48 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625082/ [6625085] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:34:06 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625085/ [6625091] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:28:47 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625091/ [6625094] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:09 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625094/ [6625097] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:08:30 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625097/ [6625100] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:17:26 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625100/ [6625103] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect_set_object} time: 00:13:39 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625103/ [6625106] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} time: 00:20:11 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625106/ [6625109] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:23:54 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625109/ [6625112] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:16:13 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625112/ [6625118] rados/dashboard/{centos_8.2_container_tools_3.0 clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:23:37 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625118/ [6625121] rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} time: 00:09:26 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625121/ [6625124] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} time: 00:13:28 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625124/ [6625127] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:28:45 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625127/ [6625130] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:10:58 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625130/ [6625133] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_18.04} time: 02:55:12 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625133/ [6625136] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:21:06 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625136/ [6625142] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:59 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625142/ [6625145] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:23:57 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625145/ [6625148] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:23:52 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625148/ [6625151] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:20:42 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625151/ [6625154] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:27:01 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625154/ [6625160] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:23:13 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625160/ [6625163] rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.3_container_tools_3.0} 2-node-mgr orchestrator_cli} time: 00:14:48 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625163/ [6625166] rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:13:24 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625166/ [6625169] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:21:17 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625169/ [6625172] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:22:15 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625172/ [6625175] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:10:43 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625175/ [6625178] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:15:29 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625178/ [6625181] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:32:49 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625181/ [6625184] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:13:17 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625184/ [6625188] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:22:06 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625188/ [6625189] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.3_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:12:28 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625189/ [6625191] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/progress} time: 00:20:55 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625191/ [6625194] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:36:28 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625194/ [6625195] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:32:25 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625195/ [6625198] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:24:44 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625198/ [6625200] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:24:06 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625200/ [6625202] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:25:07 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625202/ [6625204] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_adoption} time: 00:11:31 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625204/ [6625206] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_python} time: 00:15:07 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625206/ [6625208] rados/singleton/{all/random-eio mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:19:21 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625208/ [6625212] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:35:41 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625212/ [6625214] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:22:38 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625214/ [6625216] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:16:24 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625216/ [6625218] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:13:46 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625218/ [6625220] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:25:52 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625220/ [6625222] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:14 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625222/ [6625224] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:20:05 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625224/ [6625226] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:27:15 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625226/ [6625228] rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:13:54 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625228/ [6625232] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:19:55 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625232/ [6625234] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:10:27 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625234/ [6625236] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:12:33 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625236/ [6625238] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:11:55 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625238/ [6625240] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_workunits} time: 00:40:49 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625240/ [6625242] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:11:10 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625242/ [6625244] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:52:27 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625244/ [6625246] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} time: 00:14:54 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625246/ [6625248] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:24:06 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625248/ [6625250] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:06 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625250/ [6625252] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:43:55 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625252/ [6625254] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:24:07 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625254/ [6625256] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:39:18 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625256/ [6625257] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:46:15 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625257/ [6625258] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:41:50 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625258/ [6625259] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:11:58 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625259/ [6625260] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:19:07 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625260/ [6625261] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} time: 00:20:08 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625261/ [6625262] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:10:25 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625262/ [6625263] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} time: 00:51:49 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625263/ [6625264] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:10:06 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625264/ [6625265] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:18:39 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625265/ [6625266] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:41 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625266/ [6625267] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:42:45 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625267/ [6625269] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:22:56 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625269/ [6625270] rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:35:14 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625270/ [6625272] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:29:25 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625272/ [6625273] rados/singleton/{all/test-crash mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:11:02 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625273/ [6625274] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:10:51 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625274/ [6625275] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:35 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625275/ [6625276] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:19:39 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625276/ [6625277] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:10 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625277/ [6625278] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:19:38 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625278/ [6625279] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:23:39 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625279/ [6625280] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_cephadm_repos} time: 00:07:31 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625280/ [6625281] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:25 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625281/ [6625282] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:18:10 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625282/ [6625283] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:20:16 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625283/ [6625284] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:16:32 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625284/ [6625287] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:22:17 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625287/ [6625288] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:16:35 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625288/ [6625289] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:29:27 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625289/ [6625290] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects} time: 00:37:28 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625290/ [6625291] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:17:31 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625291/ [6625292] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:35 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625292/ [6625293] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:24:39 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625293/ [6625294] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:07:43 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625294/ [6625295] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:28:40 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625295/ [6625297] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:09:27 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625297/ [6625298] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 01:33:51 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625298/ [6625300] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:23:59 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625300/ [6625301] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:18:05 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625301/ [6625302] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:33 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625302/ [6625303] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/workunits} time: 00:10:23 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625303/ [6625304] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:31:42 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625304/ [6625305] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:18:10 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625305/ [6625306] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:10:36 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625306/ [6625307] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:17:44 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625307/ [6625308] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 01:09:54 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625308/ [6625309] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.6.2} time: 00:28:59 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625309/ [6625310] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 00:46:21 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625310/ [6625312] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:22:19 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625312/ [6625313] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:33:54 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625313/ [6625314] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:21:59 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625314/ [6625315] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 01:14:39 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625315/ [6625316] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:38 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625316/ [6625317] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:42 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625317/ [6625318] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:19:15 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625318/ [6625320] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:15:36 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625320/ [6625321] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:10:06 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625321/ [6625322] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:16:35 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625322/ [6625323] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:27:33 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625323/ [6625325] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:26:36 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625325/ [6625326] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:28:21 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625326/ [6625327] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:12:15 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625327/ [6625328] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:36:57 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625328/ [6625329] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:19:34 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625329/ [6625330] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:29:21 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625330/ [6625331] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:31:28 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625331/ [6625332] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:08:34 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625332/ [6625333] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/pool-create-delete} time: 00:27:50 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625333/ [6625335] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:24:24 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625335/ [6625337] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:15:35 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625337/ [6625338] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:14:39 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625338/ [6625339] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:20:01 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625339/ [6625340] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:09:20 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625340/ [6625341] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:13:55 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625341/ [6625342] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:46:27 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625342/ [6625343] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/crash} time: 00:23:18 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625343/ [6625344] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}} time: 02:26:29 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625344/ [6625345] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:23:55 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625345/ [6625346] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} time: 00:36:46 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625346/ [6625347] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:31:22 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625347/ [6625348] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_orch_cli} time: 00:14:48 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625348/ [6625349] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:39 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625349/ [6625350] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:18:44 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625350/ [6625351] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:13:34 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625351/ [6625352] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:23:45 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625352/ [6625353] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:22:48 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625353/ [6625354] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:19:57 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625354/ [6625355] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:12:04 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625355/ [6625358] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:06 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625358/ [6625359] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:22:26 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625359/ [6625360] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:32:44 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625360/ [6625361] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:22:16 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625361/ [6625362] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:27:45 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625362/ [6625363] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:26:07 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625363/ [6625364] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:19:50 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625364/ [6625365] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:19:10 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625365/ [6625366] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:22:15 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625366/ [6625367] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:06:31 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625367/ [6625368] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:48:08 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625368/ [6625369] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:40 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625369/ [6625370] rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:13:33 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625370/ [6625371] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:20:41 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625371/ [6625372] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:23:40 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625372/ [6625373] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:34:08 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625373/ [6625374] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:20 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625374/ [6625375] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} time: 00:09:17 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625375/ [6625376] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:24:05 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625376/ [6625377] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:26 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625377/ [6625378] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:10:20 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625378/ [6625380] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:20:22 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625380/ [6625381] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:11:39 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625381/ [6625382] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} time: 00:31:17 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625382/ [6625383] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:30 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625383/ [6625384] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:11:21 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625384/ [6625385] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:20:45 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625385/ [6625386] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache} time: 00:22:50 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625386/ [6625388] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:42:28 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625388/ [6625389] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:32:44 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625389/ [6625390] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:47:49 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625390/ [6625391] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:32:10 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625391/ [6625392] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:12:30 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625392/ [6625393] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:23:09 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625393/ [6625395] rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:13:48 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625395/ [6625396] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:21:20 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625396/ [6625397] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:29:10 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625397/ [6625399] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:32:10 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625399/ [6625401] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:35:31 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625401/ [6625402] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:22 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625402/ [6625404] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:52 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625404/ [6625405] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_cephadm} time: 00:19:18 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625405/ [6625407] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:18:22 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625407/ [6625408] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:45 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625408/ [6625409] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:30:15 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625409/ [6625410] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:14:29 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625410/ [6625411] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:11:22 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625411/ [6625412] rados/dashboard/{centos_8.2_container_tools_3.0 clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:25:04 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625412/ [6625413] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:17:02 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625413/ [6625414] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} time: 03:04:37 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625414/ [6625415] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:36:56 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625415/ [6625416] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 02:13:52 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625416/ [6625417] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:18 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625417/ [6625418] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_api_tests} time: 00:27:06 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625418/ [6625420] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:46:35 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625420/ [6625422] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:10:22 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625422/ [6625423] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:50:20 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625423/ [6625424] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:16 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625424/ [6625425] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:16:51 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625425/ [6625426] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/insights} time: 00:14:55 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625426/ [6625428] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:01 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625428/ [6625429] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:08:17 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625429/ [6625430] rados/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr orchestrator_cli} time: 00:27:40 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625430/ [6625431] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:59:27 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625431/ [6625432] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:15:10 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625432/ [6625433] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:13:48 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625433/ [6625434] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench} time: 00:52:28 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625434/ [6625435] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:23:08 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625435/ [6625436] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.3_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:12:25 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625436/ [6625437] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:06:23 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625437/ [6625438] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:28:56 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625438/ [6625439] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:24:36 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625439/ [6625441] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:08:43 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625441/ [6625442] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:29:35 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625442/ [6625443] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:06:37 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625443/ [6625444] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:58 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625444/ [6625445] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} time: 00:40:49 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625445/ [6625446] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:18:14 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625446/ [6625447] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect} time: 00:15:42 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625447/ [6625448] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:16:19 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625448/ [6625449] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:13:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625449/ [6625450] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:14:08 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625450/ [6625451] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:41 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625451/ [6625452] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:10:27 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625452/ [6625453] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 01:17:23 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625453/ [6625454] rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:23:24 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625454/ [6625456] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:20:41 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625456/ [6625457] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:17:27 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625457/ [6625458] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:24:31 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625458/ [6625459] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:13:03 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625459/ [6625460] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:11:51 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625460/ [6625461] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_osdmap_prune} time: 01:07:05 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625461/ [6625463] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:44:17 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625463/ [6625464] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:23:12 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625464/ [6625465] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:23:11 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625465/ [6625466] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:56 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625466/ [6625467] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:31:16 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625467/ [6625468] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:37:50 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625468/ [6625469] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:18:27 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625469/ [6625470] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:23:58 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625470/ [6625471] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:14:02 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625471/ [6625472] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_nfs} time: 00:23:07 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625472/ [6625473] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:19:31 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625473/ [6625474] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:09:22 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625474/ [6625475] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:19:27 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625475/ [6625476] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:47 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625476/ [6625477] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects} time: 00:22:58 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625477/ [6625479] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:12:48 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625479/ [6625480] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:35:20 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625480/ [6625481] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:12:10 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625481/ [6625482] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:52 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625482/ [6625483] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:13:36 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625483/ [6625484] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:22:28 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625484/ [6625485] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:11:57 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625485/ [6625486] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:34:13 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625486/ [6625487] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:29:42 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625487/ [6625489] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:11:29 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625489/ [6625490] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:20:23 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625490/ [6625491] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:20:09 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625491/ [6625492] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:20:55 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625492/ [6625493] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:31:07 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625493/ [6625494] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:06:45 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625494/ [6625496] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:24:46 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625496/ [6625498] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:24:10 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625498/ [6625499] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:42:09 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625499/ [6625500] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} time: 00:59:51 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625500/ [6625501] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:33:26 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625501/ [6625502] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:08:16 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625502/ [6625503] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_workunits} time: 00:41:51 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625503/ [6625504] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} time: 00:22:04 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625504/ [6625505] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/progress} time: 00:31:35 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625505/ [6625506] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} time: 03:06:24 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625506/ [6625507] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:33:56 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625507/ [6625508] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:13:22 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625508/ [6625509] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:21:36 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625509/ [6625511] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:09:16 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625511/ [6625513] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:45:06 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625513/ [6625514] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:14:39 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625514/ [6625515] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:20:43 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625515/ [6625516] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:17:46 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625516/ [6625517] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects} time: 00:26:20 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625517/ [6625518] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:14:52 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625518/ [6625519] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:22:56 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625519/ [6625520] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:33:46 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625520/ [6625522] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} time: 00:21:08 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625522/ [6625523] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:45:44 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625523/ [6625524] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:25:14 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625524/ [6625526] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:22:32 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625526/ [6625527] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:29 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625527/ [6625529] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:39:10 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625529/ [6625530] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:12:24 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625530/ [6625531] rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:13:25 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625531/ [6625532] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:28:18 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625532/ [6625533] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:15:26 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625533/ [6625534] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:13:44 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625534/ [6625535] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:09:09 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625535/ [6625536] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:11:25 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625536/ [6625537] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:10:06 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625537/ [6625538] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:13:07 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625538/ [6625539] rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:21:16 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625539/ [6625540] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:00 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625540/ [6625541] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:52:30 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625541/ [6625542] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:39:21 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625542/ [6625543] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} time: 00:17:21 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625543/ [6625544] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:24:11 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625544/ [6625545] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/snaps-few-objects} time: 00:26:45 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625545/ [6625546] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:24:09 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625546/ [6625547] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:10:01 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625547/ [6625549] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:18:50 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625549/ [6625550] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:26:46 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625550/ [6625551] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:37:59 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625551/ [6625552] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:23:05 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625552/ [6625553] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:15 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625553/ [6625554] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:18:51 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625554/ [6625555] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:29:53 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625555/ [6625556] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:36:39 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625556/ [6625557] rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:13:36 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625557/ [6625558] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:13:13 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625558/ [6625559] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:41:03 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625559/ [6625560] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:22:57 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625560/ [6625561] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:13:08 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625561/ [6625562] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:20:57 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625562/ [6625563] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:13:03 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625563/ [6625564] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_cephadm} time: 00:16:10 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625564/ [6625565] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 01:43:20 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625565/ [6625567] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:09:51 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625567/ [6625568] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:15 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625568/ [6625569] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.3_container_tools_3.0 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:27:22 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625569/ [6625570] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:29:28 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625570/ [6625572] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:20:27 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625572/ [6625573] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/repave-all} time: 00:10:51 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625573/ [6625574] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:19:25 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625574/ [6625575] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:22:33 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625575/ [6625576] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:19:29 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625576/ [6625577] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:22:51 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625577/ [6625578] rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}} time: 04:46:30 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625578/ [6625579] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:17:25 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625579/ [6625580] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:57 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625580/ [6625582] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:49:23 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625582/ [6625583] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/mon_recovery validater/valgrind} time: 00:30:05 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625583/ [6625584] rados/singleton/{all/peer mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:09:57 info: http://pulpito.ceph.com/yuriw-2022-01-18_19:06:04-rados-wip-yuri5-testing-2022-01-18-0831-pacific-distro-default-smithi/6625584/