2022-04-23T12:12:53.906 INFO:root:teuthology version: 1.1.1.dev313+g1b11219b 2022-04-23T12:12:53.907 INFO:teuthology.results:seed: '719' 2022-04-23T12:14:26.711 INFO:root:teuthology version: 1.1.1.dev313+g1b11219b 2022-04-23T12:14:26.716 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-04-23T17:43:48.246 INFO:teuthology.results:Tests finished! gathering results... 2022-04-23T17:43:48.651 INFO:scrape:Found 5 jobs 2022-04-23T17:43:48.772 INFO:scrape:Found 2 distinct failure reasons 2022-04-23T17:43:48.772 INFO:scrape:Failure: SSH connection to smithi146 was lost: 'uname -r' 2022-04-23T17:43:48.772 INFO:scrape:2 jobs: ['6802144', '6802142'] 2022-04-23T17:43:48.773 INFO:scrape:suites intersection: [] 2022-04-23T17:43:48.773 INFO:scrape:suites union: ['1-ceph-install/octopus', '1.1.short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{fsx', '5-finish-upgrade', '6-final-workload/{rbd-python', 'objectstore/bluestore-comp', 'radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'supported-all-distro/ubuntu_latest', 'supported-all-distro/ubuntu_latest}', 'thrashosds-health}', 'upgrade:octopus-p2p/octopus-p2p-parallel/{point-to-point-upgrade', 'upgrade:octopus-p2p/octopus-p2p-stress-split/{0-cluster/{openstack'] 2022-04-23T17:43:48.773 INFO:scrape: 2022-04-23T17:43:48.773 INFO:scrape:Failure: timed out waiting for mon to be updated with osd.2: 10660108828988 < 10660108828989 2022-04-23T17:43:48.773 INFO:scrape:1 jobs: ['6802146'] 2022-04-23T17:43:48.773 INFO:scrape:suites: ['1-ceph-install/octopus', '1.1.short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{fsx', '5-finish-upgrade', '6-final-workload/{rbd-python', 'objectstore/filestore-xfs', 'radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'supported-all-distro/ubuntu_latest', 'thrashosds-health}', 'upgrade:octopus-p2p/octopus-p2p-stress-split/{0-cluster/{openstack'] 2022-04-23T17:43:48.773 INFO:scrape: 2022-04-23T17:43:48.774 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-04-23_01:25:02-upgrade:octopus-p2p-octopus-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-04-23_01:25:02-upgrade:octopus-p2p-octopus-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-23_01:25:02-upgrade:octopus-p2p-octopus-distro-default-smithi/ failed: 1 dead: 2 running: 0 waiting: 0 queued: 0 passed: 2 Fail ================================================================= [6802146] upgrade:octopus-p2p/octopus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_latest thrashosds-health} ----------------------------------------------------------------- time: 05:20:23 info: http://pulpito.ceph.com/teuthology-2022-04-23_01:25:02-upgrade:octopus-p2p-octopus-distro-default-smithi/6802146/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-23_01:25:02-upgrade:octopus-p2p-octopus-distro-default-smithi/6802146/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f253a7090db34e1c8b96e27bf2c3adf0 timed out waiting for mon to be updated with osd.2: 10660108828988 < 10660108828989 Dead ================================================================= [6802142] upgrade:octopus-p2p/octopus-p2p-parallel/{point-to-point-upgrade supported-all-distro/ubuntu_latest} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-04-23_01:25:02-upgrade:octopus-p2p-octopus-distro-default-smithi/6802142/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-23_01:25:02-upgrade:octopus-p2p-octopus-distro-default-smithi/6802142/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a3411aa9d7a342268b5574f7cece0025 SSH connection to smithi050 was lost: 'uname -r' [6802144] upgrade:octopus-p2p/octopus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-comp supported-all-distro/ubuntu_latest thrashosds-health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-04-23_01:25:02-upgrade:octopus-p2p-octopus-distro-default-smithi/6802144/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-23_01:25:02-upgrade:octopus-p2p-octopus-distro-default-smithi/6802144/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0f0337a0c8da4f978a60c96a6b3a16c3 SSH connection to smithi146 was lost: 'uname -r' Pass ================================================================= [6802143] upgrade:octopus-p2p/octopus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/ubuntu_latest thrashosds-health} time: 03:28:09 info: http://pulpito.ceph.com/teuthology-2022-04-23_01:25:02-upgrade:octopus-p2p-octopus-distro-default-smithi/6802143/ [6802145] upgrade:octopus-p2p/octopus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-stupid supported-all-distro/ubuntu_latest thrashosds-health} time: 03:22:51 info: http://pulpito.ceph.com/teuthology-2022-04-23_01:25:02-upgrade:octopus-p2p-octopus-distro-default-smithi/6802145/