2021-11-18T19:49:06.504 INFO:root:teuthology version: 1.1.0-6cfddd5e 2021-11-18T19:49:06.506 INFO:teuthology.results:seed: '1405' 2021-11-18T19:58:33.643 INFO:root:teuthology version: 1.1.0-6cfddd5e 2021-11-18T19:58:33.648 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-11-18T20:55:38.006 INFO:teuthology.results:Tests finished! gathering results... 2021-11-18T20:55:39.071 INFO:scrape:Found 15 jobs 2021-11-18T20:55:41.490 INFO:scrape:Found 1 distinct failure reasons 2021-11-18T20:55:41.490 INFO:scrape:Failure: reached maximum tries (150) after waiting for 900 seconds 2021-11-18T20:55:41.491 INFO:scrape:8 jobs: ['6512428', '6512426', '6512424', '6512423', '6512415', '6512419', '6512417', '6512421'] 2021-11-18T20:55:41.491 INFO:scrape:suites intersection: ['1-volume/{0-create', '2-client', '3-upgrade-with-workload', '3-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'roles', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-11-18T20:55:41.492 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '3-upgrade-with-workload', '3-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'roles', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-11-18T20:55:41.492 INFO:scrape: 2021-11-18T20:55:41.494 INFO:teuthology.results:Sending results to pdonnell@redhat.com: Test Run: pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/ failed: 8 dead: 0 running: 0 waiting: 0 queued: 0 passed: 7 Fail ================================================================= [6512415] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:46:46 info: http://pulpito.ceph.com/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512415/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512415/ reached maximum tries (150) after waiting for 900 seconds [6512417] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:49:04 info: http://pulpito.ceph.com/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512417/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512417/ reached maximum tries (150) after waiting for 900 seconds [6512419] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:47:12 info: http://pulpito.ceph.com/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512419/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512419/ reached maximum tries (150) after waiting for 900 seconds [6512421] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:49:35 info: http://pulpito.ceph.com/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512421/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512421/ reached maximum tries (150) after waiting for 900 seconds [6512423] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:47:46 info: http://pulpito.ceph.com/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512423/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512423/ reached maximum tries (150) after waiting for 900 seconds [6512424] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:47:15 info: http://pulpito.ceph.com/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512424/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512424/ reached maximum tries (150) after waiting for 900 seconds [6512426] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:47:39 info: http://pulpito.ceph.com/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512426/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512426/ reached maximum tries (150) after waiting for 900 seconds [6512428] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:47:32 info: http://pulpito.ceph.com/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512428/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512428/ reached maximum tries (150) after waiting for 900 seconds Pass ================================================================= [6512414] fs:upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:26:44 info: http://pulpito.ceph.com/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512414/ [6512416] fs:upgrade/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-upgrade}} time: 00:10:25 info: http://pulpito.ceph.com/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512416/ [6512418] fs:upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:20:03 info: http://pulpito.ceph.com/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512418/ [6512420] fs:upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}} time: 00:23:04 info: http://pulpito.ceph.com/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512420/ [6512422] fs:upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:28:43 info: http://pulpito.ceph.com/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512422/ [6512425] fs:upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:20:02 info: http://pulpito.ceph.com/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512425/ [6512427] fs:upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}} time: 00:21:26 info: http://pulpito.ceph.com/pdonnell-2021-11-18_19:48:48-fs:upgrade-wip-pdonnell-testing-20211118.151903-distro-basic-smithi/6512427/