2021-02-27T13:10:48.375 INFO:root:teuthology version: 1.1.0-7a21eca3 2021-02-27T13:10:48.378 INFO:teuthology.results:subset: '111/120000' 2021-02-27T13:10:48.378 INFO:teuthology.results:seed: '3779' 2021-02-27T13:15:31.396 INFO:root:teuthology version: 1.1.0-7a21eca3 2021-02-27T13:15:31.434 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-02-28T01:16:24.430 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2021-02-28T01:16:25.099 INFO:scrape:Found 5 jobs 2021-02-28T01:16:26.714 INFO:scrape:Found 3 distinct failure reasons 2021-02-28T01:16:26.715 INFO:scrape:Dead: b'2021-02-28T01:16:25.108 INFO:teuthology.orchestra.run.smithi150.stderr:2021-02-28 01:16:23.045 7f6dbf07d700 0 --1- 172.21.15.150:0/2262310797 >> v1:172.21.15.150:6825/420708 conn(0x7f6da001bfe0 0x7f6da001b000 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_2 connect got BADAUTHORIZER' 2021-02-28T01:16:26.716 INFO:scrape:1 jobs: ['5916588'] 2021-02-28T01:16:26.716 INFO:scrape:suites: ['1-ceph-install/mimic', '1.1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{radosbench', '5-finish-upgrade', '6-nautilus', '6.1-msgr2', '7-final-workload/{rbd-python', 'objectstore/filestore-xfs', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw-swift-ragweed_check', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'supported-all-distro/rhel_7', 'thrashosds-health}', 'upgrade:mimic-x/stress-split/{0-cluster/{openstack'] 2021-02-28T01:16:26.717 INFO:scrape: 2021-02-28T01:16:26.717 INFO:scrape:Failure: Command failed on smithi133 with status 123: "find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" 2021-02-28T01:16:26.718 INFO:scrape:1 jobs: ['5916586'] 2021-02-28T01:16:26.718 INFO:scrape:suites: ['1-ceph-install/mimic', '1.1-pg-log-overrides/normal_pg_log', '2-workload/{blogbench', '3-upgrade-sequence/upgrade-mon-osd-mds', '4-msgr2', '4-nautilus', '5-final-workload/{blogbench', 'ec-rados-default', 'objectstore/filestore-xfs', 'rados-snaps-few-objects', 'rados_api', 'rados_loadgenbig', 'rados_loadgenmix', 'rados_mon_thrash', 'rbd_cls', 'rbd_import_export', 'rgw', 'rgw_ragweed_check', 'rgw_ragweed_prepare', 'rgw_swift}', 'start}', 'supported-all-distro/rhel_7}', 'test_rbd_api', 'test_rbd_python}', 'upgrade:mimic-x/parallel/{0-cluster/{openstack'] 2021-02-28T01:16:26.719 INFO:scrape: 2021-02-28T01:16:26.719 INFO:scrape:Dead: b'2021-02-28T01:16:26.669 INFO:tasks.ceph.osd.10.smithi094.stderr:2021-02-28 01:16:26.666 7fdc3c4f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 34674) UID: 0' 2021-02-28T01:16:26.720 INFO:scrape:1 jobs: ['5916582'] 2021-02-28T01:16:26.720 INFO:scrape:suites: ['1-ceph-install/mimic', '1.1-pg-log-overrides/normal_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{radosbench', '5-finish-upgrade', '6-nautilus', '6.1-msgr2', '7-final-workload/{rbd-python', 'objectstore/bluestore-bitmap', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw-swift-ragweed_check', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'supported-all-distro/centos_latest', 'thrashosds-health}', 'upgrade:mimic-x/stress-split/{0-cluster/{openstack'] 2021-02-28T01:16:26.721 INFO:scrape: 2021-02-28T01:16:26.722 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2021-02-26_18:23:02-upgrade:mimic-x-wip-yuri2-testing-2021-02-26-0845-nautilus-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2021-02-26_18:23:02-upgrade:mimic-x-wip-yuri2-testing-2021-02-26-0845-nautilus-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-26_18:23:02-upgrade:mimic-x-wip-yuri2-testing-2021-02-26-0845-nautilus-distro-basic-smithi/ failed: 1 dead: 0 running: 2 waiting: 0 queued: 0 passed: 2 Fail ================================================================= [5916586] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-msgr2 4-nautilus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check rgw_swift} objectstore/filestore-xfs supported-all-distro/rhel_7} ----------------------------------------------------------------- time: 02:35:55 info: http://pulpito.ceph.com/yuriw-2021-02-26_18:23:02-upgrade:mimic-x-wip-yuri2-testing-2021-02-26-0845-nautilus-distro-basic-smithi/5916586/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-26_18:23:02-upgrade:mimic-x-wip-yuri2-testing-2021-02-26-0845-nautilus-distro-basic-smithi/5916586/ Command failed on smithi133 with status 123: "find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" Running ================================================================= [5916582] upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-nautilus 6.1-msgr2 7-final-workload/{rbd-python rgw-swift-ragweed_check snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/centos_latest thrashosds-health} info: http://pulpito.ceph.com/yuriw-2021-02-26_18:23:02-upgrade:mimic-x-wip-yuri2-testing-2021-02-26-0845-nautilus-distro-basic-smithi/5916582/ [5916588] upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-nautilus 6.1-msgr2 7-final-workload/{rbd-python rgw-swift-ragweed_check snaps-many-objects} objectstore/filestore-xfs supported-all-distro/rhel_7 thrashosds-health} info: http://pulpito.ceph.com/yuriw-2021-02-26_18:23:02-upgrade:mimic-x-wip-yuri2-testing-2021-02-26-0845-nautilus-distro-basic-smithi/5916588/ Pass ================================================================= [5916580] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-msgr2 4-nautilus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check rgw_swift} objectstore/bluestore-bitmap supported-all-distro/centos_latest} time: 02:33:38 info: http://pulpito.ceph.com/yuriw-2021-02-26_18:23:02-upgrade:mimic-x-wip-yuri2-testing-2021-02-26-0845-nautilus-distro-basic-smithi/5916580/ [5916584] upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-luminous-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-ec-workload 5-finish-upgrade 7-final-workload objectstore/bluestore-bitmap supported-all-distro/centos_latest thrashosds-health} time: 00:49:50 info: http://pulpito.ceph.com/yuriw-2021-02-26_18:23:02-upgrade:mimic-x-wip-yuri2-testing-2021-02-26-0845-nautilus-distro-basic-smithi/5916584/