2022-01-10T03:37:50.392 INFO:root:teuthology version: 1.1.0-00e09f05 2022-01-10T03:37:50.394 INFO:teuthology.results:seed: '9902' 2022-01-10T04:00:31.746 INFO:root:teuthology version: 1.1.0-00e09f05 2022-01-10T04:00:31.789 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-01-10T07:39:47.763 INFO:teuthology.results:Tests finished! gathering results... 2022-01-10T07:39:49.449 INFO:scrape:Found 16 jobs 2022-01-10T07:39:49.855 INFO:scrape:Found 1 distinct failure reasons 2022-01-10T07:39:49.855 INFO:scrape:Failure: SSH connection to smithi026 was lost: 'uname -r' 2022-01-10T07:39:49.856 INFO:scrape:7 jobs: ['6601335', '6601338', '6601340', '6601349', '6601348', '6601339', '6601336'] 2022-01-10T07:39:49.856 INFO:scrape:suites intersection: ['start}', 'ubuntu_18.04}'] 2022-01-10T07:39:49.857 INFO:scrape:suites union: ['1-ceph-install/nautilus', '1-nautilus-install/nautilus', '1.1-pg-log-overrides/normal_pg_log', '1.1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '2-workload/{blogbench', '3-thrash/default', '3-upgrade-sequence/upgrade-all', '3-upgrade-sequence/upgrade-mon-osd-mds', '3.1-objectstore/filestore-xfs', '4-ec-workload/{rados-ec-workload', '4-octopus', '4-workload/{radosbench', '5-final-workload/{blogbench', '5-finish-upgrade', '6-octopus', '7-final-workload', '7-msgr2', '8-final-workload/{rbd-python', 'ec-rados-default', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'rados-snaps-few-objects', 'rados_api', 'rados_loadgenbig', 'rados_loadgenmix', 'rados_mon_thrash', 'rbd-cls', 'rbd-ec-workload}', 'rbd-import-export', 'rbd_api', 'rbd_cls', 'rbd_import_export', 'readwrite', 'rgw', 'rgw_ragweed_check}', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'test_rbd_api', 'test_rbd_python}', 'thrashosds-health', 'ubuntu_18.04}', 'upgrade:nautilus-x/parallel/{0-cluster/{openstack', 'upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack', 'upgrade:nautilus-x/stress-split/{0-cluster/{openstack'] 2022-01-10T07:39:49.857 INFO:scrape: 2022-01-10T07:39:49.859 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/ failed: 0 dead: 7 running: 0 waiting: 0 queued: 0 passed: 9 Dead ================================================================= [6601335] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601335/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601335/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4f39f664e836442a829bf5e4d67b7182 SSH connection to smithi026 was lost: 'uname -r' [6601336] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601336/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601336/ sentry: https://sentry.ceph.com/organizations/ceph/?query=263498dd895c46839f9db0ef50aa9622 SSH connection to smithi057 was lost: 'uname -r' [6601338] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601338/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601338/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a3757dc511124770a26f9b98cb2f2d47 SSH connection to smithi012 was lost: 'uname -r' [6601339] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601339/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601339/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aa7f360bab854f498ad1c4db025c75c2 SSH connection to smithi033 was lost: 'uname -r' [6601340] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601340/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601340/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cb86ab4ce83a46d3a000722cfc8d4d61 SSH connection to smithi025 was lost: 'uname -r' [6601348] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601348/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601348/ sentry: https://sentry.ceph.com/organizations/ceph/?query=351eda95d12d4502abf1493f36cae8e2 SSH connection to smithi026 was lost: 'uname -r' [6601349] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601349/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601349/ sentry: https://sentry.ceph.com/organizations/ceph/?query=806c3384003b4f389b0e8490b941cf56 SSH connection to smithi179 was lost: 'uname -r' Pass ================================================================= [6601337] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} time: 00:55:38 info: http://pulpito.ceph.com/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601337/ [6601341] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} time: 00:50:10 info: http://pulpito.ceph.com/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601341/ [6601342] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} time: 02:02:59 info: http://pulpito.ceph.com/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601342/ [6601343] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} time: 02:08:24 info: http://pulpito.ceph.com/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601343/ [6601344] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} time: 03:41:11 info: http://pulpito.ceph.com/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601344/ [6601345] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} time: 00:51:19 info: http://pulpito.ceph.com/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601345/ [6601346] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} time: 02:02:34 info: http://pulpito.ceph.com/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601346/ [6601347] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} time: 02:08:48 info: http://pulpito.ceph.com/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601347/ [6601350] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} time: 02:03:32 info: http://pulpito.ceph.com/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601350/