2023-08-09T14:23:15.100 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-09T14:23:15.101 INFO:teuthology.results:subset: '151/1024' 2023-08-09T14:23:15.101 INFO:teuthology.results:seed: '7185' 2023-08-09T14:40:19.045 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-09T14:40:19.049 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-08-10T02:37:12.916 INFO:teuthology.results:Tests finished! gathering results... 2023-08-10T02:37:14.314 INFO:scrape:Found 14 jobs 2023-08-10T02:37:15.383 INFO:scrape:Found 1 distinct failure reasons 2023-08-10T02:37:15.384 INFO:scrape:Dead: b'2023-08-10T02:33:25.047 DEBUG:teuthology.exit:Finished running handlers' 2023-08-10T02:37:15.385 INFO:scrape:2 jobs: ['7364226', '7364221'] 2023-08-10T02:37:15.385 INFO:scrape:suites intersection: ['1-ranks/2', '1-volume/{0-create', '2-client', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fail_fs/yes', 'fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific'] 2023-08-10T02:37:15.386 INFO:scrape:suites union: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fail_fs/yes', 'fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific'] 2023-08-10T02:37:15.386 INFO:scrape: 2023-08-10T02:37:15.388 INFO:teuthology.results:Sending results to mchangir@redhat.com: Test Run: mchangir-2023-08-09_06:54:05-fs:upgrade-wip-mchangir-testing-20230808.041738-testing-default-smithi ================================================================= info: http://pulpito.ceph.com/mchangir-2023-08-09_06:54:05-fs:upgrade-wip-mchangir-testing-20230808.041738-testing-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/mchangir-2023-08-09_06:54:05-fs:upgrade-wip-mchangir-testing-20230808.041738-testing-default-smithi/ failed: 0 dead: 2 running: 0 waiting: 0 queued: 0 passed: 12 Dead ================================================================= [7364221] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/mchangir-2023-08-09_06:54:05-fs:upgrade-wip-mchangir-testing-20230808.041738-testing-default-smithi/7364221/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2023-08-09_06:54:05-fs:upgrade-wip-mchangir-testing-20230808.041738-testing-default-smithi/7364221/ hit max job timeout [7364226] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/mchangir-2023-08-09_06:54:05-fs:upgrade-wip-mchangir-testing-20230808.041738-testing-default-smithi/7364226/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2023-08-09_06:54:05-fs:upgrade-wip-mchangir-testing-20230808.041738-testing-default-smithi/7364226/ hit max job timeout Pass ================================================================= [7364222] fs:upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/blogbench}}} time: 00:26:10 info: http://pulpito.ceph.com/mchangir-2023-08-09_06:54:05-fs:upgrade-wip-mchangir-testing-20230808.041738-testing-default-smithi/7364222/ [7364223] fs:upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:36:19 info: http://pulpito.ceph.com/mchangir-2023-08-09_06:54:05-fs:upgrade-wip-mchangir-testing-20230808.041738-testing-default-smithi/7364223/ [7364224] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:39:35 info: http://pulpito.ceph.com/mchangir-2023-08-09_06:54:05-fs:upgrade-wip-mchangir-testing-20230808.041738-testing-default-smithi/7364224/ [7364225] fs:upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:25:49 info: http://pulpito.ceph.com/mchangir-2023-08-09_06:54:05-fs:upgrade-wip-mchangir-testing-20230808.041738-testing-default-smithi/7364225/ [7364227] fs:upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} time: 00:32:29 info: http://pulpito.ceph.com/mchangir-2023-08-09_06:54:05-fs:upgrade-wip-mchangir-testing-20230808.041738-testing-default-smithi/7364227/ [7364228] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:37:36 info: http://pulpito.ceph.com/mchangir-2023-08-09_06:54:05-fs:upgrade-wip-mchangir-testing-20230808.041738-testing-default-smithi/7364228/ [7364229] fs:upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:35:21 info: http://pulpito.ceph.com/mchangir-2023-08-09_06:54:05-fs:upgrade-wip-mchangir-testing-20230808.041738-testing-default-smithi/7364229/ [7364230] fs:upgrade/nofs/{bluestore-bitmap centos_8 conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} time: 00:16:53 info: http://pulpito.ceph.com/mchangir-2023-08-09_06:54:05-fs:upgrade-wip-mchangir-testing-20230808.041738-testing-default-smithi/7364230/ [7364231] fs:upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/new_ops/{0-clients/fuse-upgrade 1-client-sanity}}} time: 00:18:10 info: http://pulpito.ceph.com/mchangir-2023-08-09_06:54:05-fs:upgrade-wip-mchangir-testing-20230808.041738-testing-default-smithi/7364231/ [7364232] fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:37:41 info: http://pulpito.ceph.com/mchangir-2023-08-09_06:54:05-fs:upgrade-wip-mchangir-testing-20230808.041738-testing-default-smithi/7364232/ [7364233] fs:upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:32:35 info: http://pulpito.ceph.com/mchangir-2023-08-09_06:54:05-fs:upgrade-wip-mchangir-testing-20230808.041738-testing-default-smithi/7364233/ [7364234] fs:upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/fsstress}}} time: 00:32:19 info: http://pulpito.ceph.com/mchangir-2023-08-09_06:54:05-fs:upgrade-wip-mchangir-testing-20230808.041738-testing-default-smithi/7364234/