2021-11-19T01:39:35.985 INFO:root:teuthology version: 1.1.0-6cfddd5e 2021-11-19T01:39:35.988 INFO:teuthology.results:seed: '6215' 2021-11-19T01:47:10.190 INFO:root:teuthology version: 1.1.0-6cfddd5e 2021-11-19T01:47:10.228 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-11-19T02:28:13.367 INFO:teuthology.results:Tests finished! gathering results... 2021-11-19T02:28:13.903 INFO:scrape:Found 8 jobs 2021-11-19T02:28:14.188 INFO:scrape:Found 1 distinct failure reasons 2021-11-19T02:28:14.189 INFO:scrape:Failure: Command failed on smithi171 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2021-11-19T02:28:14.189 INFO:scrape:4 jobs: ['6512491', '6512494', '6512493', '6512496'] 2021-11-19T02:28:14.190 INFO:scrape:suites intersection: ['1-volume/{0-create', '2-client', '3-upgrade-with-workload', '3-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'roles', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-11-19T02:28:14.190 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '3-upgrade-with-workload', '3-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'roles', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-11-19T02:28:14.191 INFO:scrape: 2021-11-19T02:28:14.192 INFO:teuthology.results:Sending results to pdonnell@redhat.com: Test Run: pdonnell-2021-11-19_01:38:07-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/pdonnell-2021-11-19_01:38:07-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-11-19_01:38:07-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/ failed: 4 dead: 0 running: 0 waiting: 0 queued: 0 passed: 4 Fail ================================================================= [6512491] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:06:49 info: http://pulpito.ceph.com/pdonnell-2021-11-19_01:38:07-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512491/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-11-19_01:38:07-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512491/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4f26f045da834aa6b8bf365f4a193043 Command failed on smithi171 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6512493] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:06:36 info: http://pulpito.ceph.com/pdonnell-2021-11-19_01:38:07-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512493/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-11-19_01:38:07-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512493/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ef38d3991878441b8ef35a14ad447339 Command failed on smithi192 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6512494] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:06:34 info: http://pulpito.ceph.com/pdonnell-2021-11-19_01:38:07-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512494/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-11-19_01:38:07-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512494/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f575f040f7564ca39f00020fcd3eb8c8 Command failed on smithi120 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6512496] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:06:34 info: http://pulpito.ceph.com/pdonnell-2021-11-19_01:38:07-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512496/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-11-19_01:38:07-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512496/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4dfdc2f869984018a4bdae5482021186 Command failed on smithi172 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' Pass ================================================================= [6512490] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:12 info: http://pulpito.ceph.com/pdonnell-2021-11-19_01:38:07-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512490/ [6512492] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:13 info: http://pulpito.ceph.com/pdonnell-2021-11-19_01:38:07-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512492/ [6512495] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:37 info: http://pulpito.ceph.com/pdonnell-2021-11-19_01:38:07-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512495/ [6512497] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:38 info: http://pulpito.ceph.com/pdonnell-2021-11-19_01:38:07-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512497/