2022-07-10T08:06:10.425 INFO:root:teuthology version: 1.1.1.dev381+g10062088 2022-07-10T08:06:10.438 INFO:teuthology.results:subset: '14688/100000' 2022-07-10T08:06:10.439 INFO:teuthology.results:seed: '4730' 2022-07-10T09:57:06.043 INFO:root:teuthology version: 1.1.1.dev381+g10062088 2022-07-10T09:57:06.121 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-07-10T10:46:10.599 INFO:teuthology.results:Tests finished! gathering results... 2022-07-10T10:46:19.787 INFO:scrape:Found 131 jobs 2022-07-10T10:46:21.910 INFO:scrape:Found 5 distinct failure reasons 2022-07-10T10:46:21.911 INFO:scrape:Failure: {'smithi169.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi119.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} 2022-07-10T10:46:21.912 INFO:scrape:30 jobs 2022-07-10T10:46:21.913 INFO:scrape:suites intersection: [] 2022-07-10T10:46:21.913 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-node-mgr', '2-ops/repave-all}', '2-ops/rm-zap-add}', '2-ops/rm-zap-flag}', '2-ops/rmdir-reactivate}', '2-services/basic', '2-services/client-keyring', '2-services/iscsi', '2-services/nfs', '2-services/nfs-ingress', '2-services/nfs-ingress-rgw-bucket', '2-services/nfs-ingress-rgw-user', '2-services/nfs-ingress2', '2-services/nfs2', '2-services/rgw', '2-thrash', '3-final}', '3-tasks/rados_api_tests', '3-tasks/snaps-few-objects', 'agent/off', 'agent/on', 'fixed-2', 'mode/packaged', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_3.0}', 'orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0', 'orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8', 'orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0', 'orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8', 'orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_3.0}', 'orch/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0', 'orch/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8', 'orch/cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0', 'orch/cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8', 'orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0', 'orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8', 'orchestrator_cli}', 'root}', 'start', 'start}', 'tasks/rados_api_tests}', 'tasks/rados_python}'] 2022-07-10T10:46:21.914 INFO:scrape: 2022-07-10T10:46:21.914 INFO:scrape:Failure: 'wait for operator' reached maximum tries (90) after waiting for 900 seconds 2022-07-10T10:46:21.915 INFO:scrape:3 jobs: ['6922298', '6922496', '6922430'] 2022-07-10T10:46:21.915 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', '3-final', 'k8s/1.21', 'orch/rook/smoke/{0-distro/ubuntu_20.04'] 2022-07-10T10:46:21.916 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', '3-final', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/flannel', 'net/host', 'orch/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}', 'rook/master}'] 2022-07-10T10:46:21.916 INFO:scrape: 2022-07-10T10:46:21.916 INFO:scrape:Failure: Command failed on smithi053 with status 22: 'kubectl -n rook-ceph exec rook-ceph-tools-6db9f859bb-bbfzb -- ceph orch apply osd --all-available-devices' 2022-07-10T10:46:21.917 INFO:scrape:1 jobs: ['6922365'] 2022-07-10T10:46:21.917 INFO:scrape:suites: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '3-final', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'orch/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}'] 2022-07-10T10:46:21.918 INFO:scrape: 2022-07-10T10:46:21.918 INFO:scrape:Failure: {'smithi008.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi161.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} 2022-07-10T10:46:21.919 INFO:scrape:1 jobs: ['6922300'] 2022-07-10T10:46:21.919 INFO:scrape:suites: ['1-start', '2-thrash', '3-tasks/small-objects', 'fixed-2', 'msgr/async', 'orch/cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0', 'root}'] 2022-07-10T10:46:21.920 INFO:scrape: 2022-07-10T10:46:21.920 INFO:scrape:Failure: Command failed on smithi149 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd03bb64-0038-11ed-842e-001a4aab830c -- ceph mon dump -f json' 2022-07-10T10:46:21.921 INFO:scrape:1 jobs: ['6922500'] 2022-07-10T10:46:21.921 INFO:scrape:suites: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{pg-warn', 'roles', 'syntax', 'tasks/{0-from/pacific', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-07-10T10:46:21.922 INFO:scrape: 2022-07-10T10:46:21.926 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/ failed: 5 dead: 31 running: 0 waiting: 0 queued: 0 passed: 95 Fail ================================================================= [6922298] orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/host rook/1.7.2} ----------------------------------------------------------------- time: 00:23:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922298/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922298/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3a89f6fc925c4393b9926afe043b1b6f 'wait for operator' reached maximum tries (90) after waiting for 900 seconds [6922365] orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:17:14 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922365/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922365/ sentry: https://sentry.ceph.com/organizations/ceph/?query=87663453c56444b4ab1481ac601667e4 Command failed on smithi053 with status 22: 'kubectl -n rook-ceph exec rook-ceph-tools-6db9f859bb-bbfzb -- ceph orch apply osd --all-available- devices' [6922430] orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/flannel rook/1.7.2} ----------------------------------------------------------------- time: 00:22:37 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922430/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922430/ sentry: https://sentry.ceph.com/organizations/ceph/?query=04da37e27f7747f4a49637e3b7b83abf 'wait for operator' reached maximum tries (90) after waiting for 900 seconds [6922496] orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/host rook/master} ----------------------------------------------------------------- time: 00:27:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922496/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922496/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d8f029ef466c4e299ada9461ac2d1e72 'check orch status' reached maximum tries (90) after waiting for 900 seconds [6922500] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:16:29 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922500/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922500/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f13eafe6bc74421aaa4250f3a356b149 Command failed on smithi149 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest- pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd03bb64-0038-11ed-842e-001a4aab830c -- ceph mon dump -f json' Dead ================================================================= [6922250] orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_3.0} 2-node-mgr agent/off orchestrator_cli} ----------------------------------------------------------------- time: 00:07:24 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922250/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922250/ sentry: https://sentry.ceph.com/organizations/ceph/?query=59a49e7c19444bdf93d67749e5949b8a {'smithi132.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi172.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922256] orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:06:44 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922256/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922256/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5db4da4c149e41c494d2c5a3ec8a83f3 {'smithi081.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922270] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:06:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922270/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922270/ sentry: https://sentry.ceph.com/organizations/ceph/?query=24abf75218cd4be69901651d04cb0a5e {'smithi090.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi026.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922284] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} ----------------------------------------------------------------- time: 00:06:09 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922284/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922284/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c88e05d1cb2748aaa5d5a51fc22829a2 {'smithi157.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi139.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922286] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} ----------------------------------------------------------------- time: 00:06:19 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922286/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922286/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3e09575f688c4100a17979aaa7b8d62d {'smithi078.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi060.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922300] orch/cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:07:23 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922300/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922300/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3d51a47c51a347018796f623bb3c6a76 {'smithi008.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi161.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922302] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:07:22 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922302/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922302/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2501f8885bd147a9b1dca9ced5e2f17a {'smithi110.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi133.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922306] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} ----------------------------------------------------------------- time: 00:07:34 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922306/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922306/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ff705d8234d3457fa01099ab1ba7cfba {'smithi086.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi077.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922312] orch/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:07:42 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922312/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922312/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7b2f28c39b514766baeeef94242679d7 {'smithi062.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi192.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922316] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} ----------------------------------------------------------------- time: 00:07:15 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922316/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922316/ sentry: https://sentry.ceph.com/organizations/ceph/?query=90ce1bad0e78421db3efb16233122a04 {'smithi167.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi163.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922320] orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:06:41 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922320/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922320/ sentry: https://sentry.ceph.com/organizations/ceph/?query=efb1d584afde42b1940d0fb5d468b4c8 {'smithi036.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922322] orch/cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:06:37 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922322/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922322/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4cf75b552f9844dc9d49cf8340cca50f {'smithi157.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi139.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922324] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:06:26 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922324/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922324/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5b9a854a77df48cc938e11092bda6643 {'smithi002.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi038.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922326] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} ----------------------------------------------------------------- time: 00:05:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922326/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922326/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fd49cfa33aec4f3ebbaa45841177a0d5 {'smithi186.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi001.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922331] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:06:17 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922331/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922331/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0a3df9f5d60d454a9c6405fdd0e6b026 {'smithi133.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi110.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922335] orch/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:06:24 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922335/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922335/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7a6230e40f694e89937047e05b226d51 {'smithi169.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi119.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922359] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:07:13 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922359/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922359/ sentry: https://sentry.ceph.com/organizations/ceph/?query=153d018a16d24230ac8ad8b54966c1dc {'smithi002.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi038.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922367] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:07:42 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922367/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922367/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3e0db752cccb4b78a701849abdb6e066 {'smithi097.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi073.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922404] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:06:30 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922404/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922404/ sentry: https://sentry.ceph.com/organizations/ceph/?query=75544b4d61bd4d4a9099fe58b11bffc6 {'smithi195.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi155.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922408] orch/cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:06:16 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922408/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922408/ sentry: https://sentry.ceph.com/organizations/ceph/?query=929f29d66673427d8222f274845890b7 {'smithi192.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi062.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922410] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:06:05 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922410/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922410/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ab8cfdee7aea4737821df64708a0b3a4 {'smithi111.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi026.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922414] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:06:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922414/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922414/ sentry: https://sentry.ceph.com/organizations/ceph/?query=40f58eea24224a7b9fb311636dc460cb {'smithi005.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi032.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922416] orch/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:06:19 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922416/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922416/ sentry: https://sentry.ceph.com/organizations/ceph/?query=41cabce875f24fb1af498b715f81f036 {'smithi018.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi067.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922428] orch/cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:06:29 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922428/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922428/ sentry: https://sentry.ceph.com/organizations/ceph/?query=948cbae2502749d1afb0ca2f6768ab06 {'smithi171.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi131.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922432] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:06:25 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922432/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922432/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a6c5f7aba78a468589baf8bd296cdfb4 {'smithi109.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi085.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922434] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:06:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922434/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922434/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e4ed7142fe294336b347956abe4ad2cc {'smithi043.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi037.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922436] orch/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:06:26 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922436/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922436/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7270bff67a264e9f86eee0c3a9072415 {'smithi078.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi155.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922444] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:06:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922444/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922444/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eeb0e874b1824994a97de4792b648e68 {'smithi100.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi064.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922460] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:07:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922460/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922460/ sentry: https://sentry.ceph.com/organizations/ceph/?query=894d49c1899f47c9b4e0263610a3d543 {'smithi188.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi053.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922462] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:06:44 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922462/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922462/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1ada252252ad4050b73953ab7ab041c6 {'smithi131.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi171.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922486] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} ----------------------------------------------------------------- time: 00:07:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922486/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922486/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b1c39cadaccb4da3b799866276ea602a {'smithi201.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi040.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} Pass ================================================================= [6922240] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:49:17 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922240/ [6922242] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:17:46 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922242/ [6922244] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:23:05 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922244/ [6922246] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:35:36 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922246/ [6922248] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:39:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922248/ [6922252] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} time: 00:34:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922252/ [6922254] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:20:23 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922254/ [6922258] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:38:09 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922258/ [6922260] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:39:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922260/ [6922262] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:24:53 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922262/ [6922264] orch/cephadm/workunits/{agent/off mon_election/classic task/test_orch_cli} time: 00:20:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922264/ [6922266] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:19:24 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922266/ [6922268] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:24:59 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922268/ [6922272] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:35:30 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922272/ [6922274] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:35:17 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922274/ [6922276] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:43 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922276/ [6922278] orch/cephadm/workunits/{agent/on mon_election/connectivity task/test_adoption} time: 00:10:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922278/ [6922280] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:52:57 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922280/ [6922282] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:25:18 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922282/ [6922288] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:26:27 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922288/ [6922290] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:34 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922290/ [6922292] orch/cephadm/workunits/{agent/off mon_election/classic task/test_cephadm} time: 00:19:10 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922292/ [6922294] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:35:08 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922294/ [6922296] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:18:30 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922296/ [6922304] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:35:12 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922304/ [6922308] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:17:08 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922308/ [6922310] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:56:26 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922310/ [6922314] orch/cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:08:07 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922314/ [6922319] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/on orchestrator_cli} time: 00:26:37 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922319/ [6922329] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:33:15 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922329/ [6922333] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:20:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922333/ [6922337] orch/cephadm/workunits/{agent/off mon_election/classic task/test_nfs} time: 00:32:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922337/ [6922339] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:48:26 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922339/ [6922341] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:38:53 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922341/ [6922343] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:18:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922343/ [6922345] orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:48:02 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922345/ [6922347] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:45:25 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922347/ [6922349] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:20:50 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922349/ [6922351] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:35:18 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922351/ [6922353] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:19:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922353/ [6922355] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:27:49 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922355/ [6922357] orch/cephadm/workunits/{agent/on mon_election/connectivity task/test_orch_cli} time: 00:20:26 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922357/ [6922361] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:59:17 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922361/ [6922363] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} time: 00:27:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922363/ [6922369] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:17:24 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922369/ [6922371] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:36:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922371/ [6922373] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:34:29 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922373/ [6922375] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:19:05 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922375/ [6922376] orch/cephadm/workunits/{agent/on mon_election/classic task/test_adoption} time: 00:11:34 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922376/ [6922378] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:19:53 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922378/ [6922380] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:38:49 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922380/ [6922382] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/off orchestrator_cli} time: 00:20:23 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922382/ [6922384] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} time: 00:32:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922384/ [6922386] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:15:45 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922386/ [6922388] orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:14:11 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922388/ [6922390] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:32:11 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922390/ [6922392] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:39:41 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922392/ [6922394] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:16:01 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922394/ [6922396] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:16:44 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922396/ [6922398] orch/cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm} time: 00:19:21 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922398/ [6922400] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:19:46 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922400/ [6922402] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:35:27 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922402/ [6922406] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:54:48 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922406/ [6922412] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} time: 00:15:02 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922412/ [6922418] orch/cephadm/workunits/{agent/on mon_election/classic task/test_cephadm_repos} time: 00:06:45 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922418/ [6922420] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:19:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922420/ [6922422] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:52 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922422/ [6922424] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:34:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922424/ [6922426] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:16:26 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922426/ [6922438] orch/cephadm/workunits/{agent/off mon_election/connectivity task/test_nfs} time: 00:33:07 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922438/ [6922440] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:17:27 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922440/ [6922442] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:30:14 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922442/ [6922446] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:35:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922446/ [6922448] orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/on orchestrator_cli} time: 00:23:24 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922448/ [6922450] orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} time: 00:15:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922450/ [6922452] orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 01:01:02 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922452/ [6922454] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:32:36 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922454/ [6922456] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:26:33 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922456/ [6922458] orch/cephadm/workunits/{agent/on mon_election/classic task/test_orch_cli} time: 00:20:11 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922458/ [6922464] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:25:26 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922464/ [6922466] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:56:02 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922466/ [6922468] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:34:38 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922468/ [6922470] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:18:40 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922470/ [6922472] orch/cephadm/workunits/{agent/off mon_election/connectivity task/test_adoption} time: 00:11:39 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922472/ [6922474] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:39:25 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922474/ [6922476] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:20:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922476/ [6922478] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:34:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922478/ [6922480] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:39:24 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922480/ [6922482] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:19:18 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922482/ [6922484] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:17:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922484/ [6922488] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:18:42 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922488/ [6922490] orch/cephadm/workunits/{agent/on mon_election/classic task/test_cephadm} time: 00:20:34 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922490/ [6922492] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:39:16 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922492/ [6922494] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} time: 00:26:07 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922494/ [6922498] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:16:27 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:07:03-orch-quincy-distro-default-smithi/6922498/