2021-12-02T21:05:44.513 INFO:root:teuthology version: 1.1.0-844d1377
2021-12-02T21:05:44.514 INFO:teuthology.results:subset: '111/999'
2021-12-02T21:05:44.515 INFO:teuthology.results:seed: '2873'
2021-12-02T21:46:56.284 INFO:root:teuthology version: 1.1.0-844d1377
2021-12-02T21:46:56.323 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-12-03T09:19:52.060 INFO:teuthology.results:Tests finished! gathering results...
2021-12-03T09:19:59.049 INFO:scrape:Found 74 jobs
2021-12-03T09:20:05.305 INFO:scrape:Found 4 distinct failure reasons
2021-12-03T09:20:05.306 INFO:scrape:Dead: b'2021-12-03T09:12:29.516 DEBUG:teuthology.exit:Finished running handlers'
2021-12-03T09:20:05.306 INFO:scrape:1 jobs: ['6541057']
2021-12-03T09:20:05.307 INFO:scrape:suites: ['1-bootstrap/octopus', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools']
2021-12-03T09:20:05.307 INFO:scrape:
2021-12-03T09:20:05.308 INFO:scrape:Failure: timeout expired in wait_until_healthy
2021-12-03T09:20:05.308 INFO:scrape:25 jobs: ['6541095', '6541120', '6541104', '6541078', '6541067', '6541086', '6541085', '6541082', '6541088', '6541124', '6541062', '6541058', '6541068', '6541111', '6541100', '6541093', '6541097', '6541075', '6541114', '6541106', '6541122', '6541071', '6541126', '6541115', '6541060']
2021-12-03T09:20:05.309 INFO:scrape:suites intersection: ['1-start']
2021-12-03T09:20:05.309 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-ops/repave-all}', '2-ops/rm-zap-add}', '2-ops/rm-zap-flag}', '2-ops/rm-zap-wait}', '2-services/basic', '2-services/client-keyring', '2-services/iscsi', '2-services/mirror', '2-services/nfs', '2-services/nfs-ingress', '2-services/nfs-ingress-rgw-bucket', '2-services/nfs-ingress-rgw-user', '2-services/nfs-ingress2', '2-services/nfs2', '2-services/rgw', '2-services/rgw-ingress', '3-final}', 'orch:cephadm/osds/{0-distro/centos_8.2_container_tools_3.0', 'orch:cephadm/osds/{0-distro/centos_8.3_container_tools_3.0', 'orch:cephadm/osds/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8', 'orch:cephadm/osds/{0-distro/ubuntu_20.04', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8', 'orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04', 'orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.2_container_tools_3.0}', 'orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools}']
2021-12-03T09:20:05.310 INFO:scrape:
2021-12-03T09:20:05.310 INFO:scrape:Failure: Command failed on smithi148 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,nofallback'
2021-12-03T09:20:05.311 INFO:scrape:8 jobs: ['6541109', '6541079', '6541128', '6541090', '6541063', '6541070', '6541118', '6541099']
2021-12-03T09:20:05.311 INFO:scrape:suites intersection: ['1-volume/{0-create', '2-client', '3-upgrade-with-workload', '3-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{pg-warn', 'roles', 'syntax', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-12-03T09:20:05.312 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '3-upgrade-with-workload', '3-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{pg-warn', 'roles', 'syntax', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-12-03T09:20:05.312 INFO:scrape:
2021-12-03T09:20:05.313 INFO:scrape:Failure: "2021-12-02T21:42:05.379018+0000 mon.a (mon.0) 138 : cluster [WRN] Health check failed: 2 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log
2021-12-03T09:20:05.313 INFO:scrape:1 jobs: ['6541081']
2021-12-03T09:20:05.313 INFO:scrape:suites: ['2-node-mgr', 'agent/off', 'orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8}', 'orchestrator_cli}']
2021-12-03T09:20:05.314 INFO:scrape: