2022-02-12T05:46:14.313 INFO:root:teuthology version: 1.1.0-7cebb3f2 2022-02-12T05:46:14.315 INFO:teuthology.results:subset: '1111/9999' 2022-02-12T05:46:14.315 INFO:teuthology.results:seed: '8971' 2022-02-12T06:09:16.121 INFO:root:teuthology version: 1.1.0-7cebb3f2 2022-02-12T06:09:16.152 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-02-12T12:40:44.090 INFO:teuthology.results:Tests finished! gathering results... 2022-02-12T12:40:53.922 INFO:scrape:Found 63 jobs 2022-02-12T12:40:58.322 INFO:scrape:Found 4 distinct failure reasons 2022-02-12T12:40:58.324 INFO:scrape:Failure: Command failed on smithi046 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' 2022-02-12T12:40:58.324 INFO:scrape:41 jobs 2022-02-12T12:40:58.325 INFO:scrape:suites intersection: [] 2022-02-12T12:40:58.325 INFO:scrape:suites union: ['0-nvme-loop', '1-bootstrap/16.2.4', '1-bootstrap/16.2.5', '1-bootstrap/octopus', '1-ranks/1', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-nfs', '2-ops/repave-all}', '2-ops/rm-zap-add}', '2-ops/rm-zap-flag}', '2-ops/rmdir-reactivate}', '2-repo_digest/defaut', '2-services/basic', '2-services/iscsi', '2-services/mirror', '2-services/nfs', '2-services/nfs-ingress-rgw-bucket', '2-services/nfs-ingress-rgw-user', '2-services/nfs-ingress2', '2-services/nfs2', '2-services/rgw', '2-services/rgw-ingress', '2-thrash', '3-final}', '3-inline/no', '3-inline/yes', '3-start-upgrade', '3-tasks/rados_api_tests', '3-tasks/radosbench', '3-tasks/snaps-few-objects', '3-upgrade-with-workload', '4-final}', '4-verify}', '4-verify}}', '4-wait', '5-upgrade-ls', 'agent/off', 'agent/on', 'base/install', 'centos_8.stream_container_tools', 'cluster/{fixed-3', 'conf/{client', 'fixed-2', 'mds', 'mode/root', 'mon', 'mon_election/classic', 'mon_election/connectivity', 'mon_election/connectivity}', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'openstack}', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools', 'orch:cephadm/osds/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8', 'orch:cephadm/rbd_iscsi/{0-single-container-host', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8', 'orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools}', 'orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8', 'orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8', 'orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools', 'orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0', 'osd}', 'overrides/{pg-warn', 'roles', 'root}', 'start', 'start}', 'syntax', 'tasks/rados_api_tests}', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workloads/cephadm_iscsi}'] 2022-02-12T12:40:58.326 INFO:scrape: 2022-02-12T12:40:58.327 INFO:scrape:Failure: Test failure: test_cluster_set_reset_user_config (tasks.cephfs.test_nfs.TestNFS) 2022-02-12T12:40:58.327 INFO:scrape:1 jobs: ['6678088'] 2022-02-12T12:40:58.328 INFO:scrape:suites: ['mon_election/connectivity', 'orch:cephadm/workunits/{agent/on', 'task/test_nfs}'] 2022-02-12T12:40:58.328 INFO:scrape: 2022-02-12T12:40:58.329 INFO:scrape:Failure: Command failed on smithi064 with status 5: 'sudo systemctl stop ceph-5f5969c6-8bca-11ec-8c35-001a4aab830c@mon.a' 2022-02-12T12:40:58.329 INFO:scrape:3 jobs: ['6678070', '6678052', '6678101'] 2022-02-12T12:40:58.330 INFO:scrape:suites intersection: ['3-start-upgrade', '4-wait', '5-upgrade-ls'] 2022-02-12T12:40:58.330 INFO:scrape:suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', '5-upgrade-ls', 'agent/off', 'agent/on', 'mon_election/classic}', 'mon_election/connectivity}', 'orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04', 'orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9'] 2022-02-12T12:40:58.331 INFO:scrape: 2022-02-12T12:40:58.331 INFO:scrape:Dead: b'2022-02-12T12:36:31.691 DEBUG:teuthology.exit:Finished running handlers' 2022-02-12T12:40:58.332 INFO:scrape:1 jobs: ['6678089'] 2022-02-12T12:40:58.332 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/nfs-ingress', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04'] 2022-02-12T12:40:58.333 INFO:scrape: 2022-02-12T12:40:58.336 INFO:teuthology.results:Sending results to mfritch@suse.com: Test Run: mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/ failed: 45 dead: 1 running: 0 waiting: 0 queued: 0 passed: 17 Fail ================================================================= [6678052] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} ----------------------------------------------------------------- time: 00:03:34 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678052/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678052/ sentry: https://sentry.ceph.com/organizations/ceph/?query=06b9fbe937214e5e9e0d974f4fcb9685 Command failed on smithi148 with status 5: 'sudo systemctl stop ceph-e0ac6084-8bc8-11ec-8c35-001a4aab830c@mon.a' [6678053] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} ----------------------------------------------------------------- time: 00:03:34 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678053/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678053/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0aae4eb70e0641b69d92f0c8f5415271 Command failed on smithi001 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678054] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:03:24 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678054/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678054/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e06a82a9764540fdbbc745582bed164c Command failed on smithi089 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678055] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:06:08 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678055/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678055/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b45f007b4a4e4ea6b851f465255320f8 Command failed on smithi059 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678056] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:03:51 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678056/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678056/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b3b52c6d7fda40789e2b1312943cb7b4 Command failed on smithi102 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678058] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} ----------------------------------------------------------------- time: 00:03:29 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678058/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678058/ sentry: https://sentry.ceph.com/organizations/ceph/?query=39c00d45eb264142b6ac6a95fef60778 Command failed on smithi019 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678059] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:03:30 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678059/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678059/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0b466737f2b247d59513d899b5181c8f Command failed on smithi023 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678062] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:09:57 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678062/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678062/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fb2ce0b2bea84ddcb0f60dbcb960a467 Command failed on smithi116 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678063] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:06:18 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678063/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678063/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8d5fd60ffd5e432585d3e316afe0e58a Command failed on smithi002 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678065] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} ----------------------------------------------------------------- time: 00:03:25 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678065/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678065/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9f7d0ea39f024f978bf038c1f9cda96e Command failed on smithi121 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678066] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:10:24 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678066/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678066/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7151334b407741a991bc27358c47e2b4 Command failed on smithi038 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678067] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:03:25 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678067/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678067/ sentry: https://sentry.ceph.com/organizations/ceph/?query=72f1cfc0fd5849a6a34564d4223ae7b1 Command failed on smithi138 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678070] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} ----------------------------------------------------------------- time: 00:03:42 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678070/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678070/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3013e1c00cc448c9ba04479ebd508315 Command failed on smithi064 with status 5: 'sudo systemctl stop ceph-5f5969c6-8bca-11ec-8c35-001a4aab830c@mon.a' [6678071] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:06:02 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678071/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678071/ sentry: https://sentry.ceph.com/organizations/ceph/?query=76d33ac2d0c545d0b9f01f639318141d Command failed on smithi016 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678072] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} ----------------------------------------------------------------- time: 00:03:26 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678072/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678072/ sentry: https://sentry.ceph.com/organizations/ceph/?query=db66d7f014f24f0ea1c7375f346b37ac Command failed on smithi111 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678073] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:21:14 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678073/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678073/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5b3a7d3babbd4e309edc84baaf2b7894 Command failed on smithi008 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678074] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:21:34 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678074/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678074/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ddfc72ecff5b43b8b8225dabf8774a45 Command failed on smithi027 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678075] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:09:59 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678075/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678075/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6355c157d5954c4aaaa46919e8c0d2ec Command failed on smithi071 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678076] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/mirror 3-final} ----------------------------------------------------------------- time: 00:03:30 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678076/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678076/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aa500f8937574deda6445480afda3d0a Command failed on smithi067 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678077] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:10:27 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678077/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678077/ sentry: https://sentry.ceph.com/organizations/ceph/?query=957e1c1ab5e740869b5ccda5fcd5a39e Command failed on smithi042 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678079] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:03:26 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678079/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678079/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1fadcb9952974cc78e0b9168f4baa448 Command failed on smithi046 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678080] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:10:27 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678080/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678080/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ec1655031be8487c93f79d36fd4fcd04 Command failed on smithi005 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678081] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:06:22 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678081/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678081/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b8476fd8cb4040eeb77a8c6bd735bd09 Command failed on smithi001 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678082] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:20:18 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678082/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678082/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9902743da08d42ca9978501b4e970f1f Command failed on smithi132 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678084] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:09:59 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678084/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678084/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ea40945bd2894b3689cda4d7b868c165 Command failed on smithi117 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678085] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} ----------------------------------------------------------------- time: 00:03:25 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678085/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678085/ sentry: https://sentry.ceph.com/organizations/ceph/?query=232b8d4c5448426ea2efb3ded0cb97b9 Command failed on smithi036 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678086] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:10:00 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678086/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678086/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f0f493f1753742b2a26bcc254f99789f Command failed on smithi197 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678087] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:10:25 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678087/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678087/ sentry: https://sentry.ceph.com/organizations/ceph/?query=807541b1bb994b9592b4e2a664298b87 Command failed on smithi039 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678088] orch:cephadm/workunits/{agent/on mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:16:36 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678088/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678088/ sentry: https://sentry.ceph.com/organizations/ceph/?query=777eed6b6290415eb7c0528583924739 Test failure: test_cluster_set_reset_user_config (tasks.cephfs.test_nfs.TestNFS) [6678091] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:03:18 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678091/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678091/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f819745931504036997cff4191a27e9c Command failed on smithi148 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678092] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:03:28 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678092/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678092/ sentry: https://sentry.ceph.com/organizations/ceph/?query=afb09affcee8475996cec9840c734d27 Command failed on smithi079 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678095] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:05:55 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678095/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678095/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1318cc7acd3f41b592c52785b13aaaac Command failed on smithi089 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678099] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:03:36 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678099/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678099/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f04bcb9392584943923f2a0359481d7b Command failed on smithi019 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678100] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:03:26 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678100/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678100/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b1734e3bc8694e8aac42fd1a0e009963 Command failed on smithi022 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678101] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} ----------------------------------------------------------------- time: 00:03:35 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678101/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678101/ sentry: https://sentry.ceph.com/organizations/ceph/?query=01fa6cef0f99406ca00d22d91c641f8d Command failed on smithi164 with status 5: 'sudo systemctl stop ceph-30292e88-8bcb-11ec-8c35-001a4aab830c@mon.a' [6678102] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} ----------------------------------------------------------------- time: 00:10:38 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678102/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678102/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0bec8b4b504b4769adf2b85de962bee5 Command failed on smithi029 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678103] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:06:31 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678103/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678103/ sentry: https://sentry.ceph.com/organizations/ceph/?query=72866419a2e0428e8407f05bbfb03480 Command failed on smithi101 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678105] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rmdir-reactivate} ----------------------------------------------------------------- time: 00:03:29 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678105/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678105/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b5b6e6db8033420f95cb774b647360c9 Command failed on smithi059 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678106] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:06:21 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678106/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678106/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c953d25683a14358bd8af04cbbe66153 Command failed on smithi073 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678107] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:03:34 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678107/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678107/ sentry: https://sentry.ceph.com/organizations/ceph/?query=119dc583a9344507bf7a7f9a020cd148 Command failed on smithi023 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678109] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:10:23 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678109/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678109/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3aa2c260b89d42ddae7a3275fed0fd61 Command failed on smithi058 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678111] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/repave-all} ----------------------------------------------------------------- time: 00:03:24 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678111/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678111/ sentry: https://sentry.ceph.com/organizations/ceph/?query=71fc2e7060ef4e2bb35305909c8c4c36 Command failed on smithi085 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678112] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:03:24 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678112/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678112/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bf1f30a49dec484293ff7bb5c5e2939e Command failed on smithi121 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678113] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:06:23 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678113/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678113/ sentry: https://sentry.ceph.com/organizations/ceph/?query=beb11760f90543988f93990ccb2a7d14 Command failed on smithi002 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [6678114] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:06:11 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678114/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678114/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e82de7a196c849d9b3893eaeca16e75f Command failed on smithi083 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' Dead ================================================================= [6678089] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678089/ log: http://qa-proxy.ceph.com/teuthology/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678089/ hit max job timeout Pass ================================================================= [6678057] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli} time: 00:27:33 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678057/ [6678060] orch:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:11:22 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678060/ [6678061] orch:cephadm/workunits/{agent/off mon_election/classic task/test_adoption} time: 00:07:13 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678061/ [6678064] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:18:57 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678064/ [6678068] orch:cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm} time: 00:14:23 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678068/ [6678069] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:13:32 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678069/ [6678078] orch:cephadm/workunits/{agent/off mon_election/classic task/test_cephadm_repos} time: 00:04:18 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678078/ [6678083] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:36:11 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678083/ [6678090] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli} time: 00:26:29 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678090/ [6678093] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:34:50 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678093/ [6678094] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:36:34 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678094/ [6678096] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:12:41 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678096/ [6678097] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:16:26 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678097/ [6678098] orch:cephadm/workunits/{agent/off mon_election/classic task/test_orch_cli} time: 00:14:05 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678098/ [6678104] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:19:38 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678104/ [6678108] orch:cephadm/workunits/{agent/on mon_election/connectivity task/test_adoption} time: 00:07:14 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678108/ [6678110] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:16:00 info: http://pulpito.ceph.com/mgfritch-2022-02-11_23:31:26-orch:cephadm-wip-mgfritch-testing-2022-02-11-1444-distro-default-smithi/6678110/