2022-07-02T17:47:16.442 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3 2022-07-02T17:47:16.444 INFO:teuthology.results:subset: '1/7' 2022-07-02T17:47:16.444 INFO:teuthology.results:seed: '8536' 2022-07-02T18:46:23.540 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3 2022-07-02T18:46:23.626 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-07-02T19:36:28.258 INFO:teuthology.results:Tests finished! gathering results... 2022-07-02T19:36:34.874 INFO:scrape:Found 90 jobs 2022-07-02T19:36:39.647 INFO:scrape:Found 6 distinct failure reasons 2022-07-02T19:36:39.648 INFO:scrape:Failure: Command failed on smithi152 with status 5: 'sudo systemctl stop ceph-5bacbbc4-fa39-11ec-842c-001a4aab830c@mon.smithi152' 2022-07-02T19:36:39.649 INFO:scrape:17 jobs: ['6909222', '6909168', '6909135', '6909139', '6909193', '6909140', '6909204', '6909180', '6909210', '6909194', '6909152', '6909156', '6909223', '6909178', '6909169', '6909167', '6909200'] 2022-07-02T19:36:39.649 INFO:scrape:suites intersection: [] 2022-07-02T19:36:39.650 INFO:scrape:suites union: ['1-bootstrap/16.2.4', '1-bootstrap/16.2.5', '1-bootstrap/octopus', '1-ranks/1', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-nfs', '2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '3-upgrade/simple', '3-upgrade/staggered', '4-final}', '4-verify}', '4-verify}}', '4-wait', '5-upgrade-ls', 'agent/off', 'agent/on', 'centos_8.stream_container_tools', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon_election/classic}', 'mon_election/connectivity}', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools', 'orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools', 'orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04', 'orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4'] 2022-07-02T19:36:39.650 INFO:scrape: 2022-07-02T19:36:39.651 INFO:scrape:Failure: Test failure: test_create_delete_cluster_idempotency (tasks.cephfs.test_nfs.TestNFS) 2022-07-02T19:36:39.651 INFO:scrape:1 jobs: ['6909190'] 2022-07-02T19:36:39.651 INFO:scrape:suites: ['mon_election/classic', 'orch:cephadm/workunits/{agent/on', 'task/test_nfs}'] 2022-07-02T19:36:39.652 INFO:scrape: 2022-07-02T19:36:39.652 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi103 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=19c5b8dbbdd59578fd7085156ce8d7836681eed0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2022-07-02T19:36:39.653 INFO:scrape:2 jobs: ['6909162', '6909217'] 2022-07-02T19:36:39.654 INFO:scrape:suites intersection: ['orch:cephadm/workunits/{agent/off', 'task/test_cephadm}'] 2022-07-02T19:36:39.654 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'orch:cephadm/workunits/{agent/off', 'task/test_cephadm}'] 2022-07-02T19:36:39.655 INFO:scrape: 2022-07-02T19:36:39.656 INFO:scrape:Failure: Command failed on smithi026 with status 123: "find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" 2022-07-02T19:36:39.657 INFO:scrape:2 jobs: ['6909220', '6909218'] 2022-07-02T19:36:39.657 INFO:scrape:suites intersection: ['fixed-2'] 2022-07-02T19:36:39.658 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-thrash', '3-tasks/rados_api_tests', 'agent/on', 'fixed-2', 'mon_election/classic', 'msgr/async-v2only', 'orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun', 'root}', 'start}'] 2022-07-02T19:36:39.659 INFO:scrape: 2022-07-02T19:36:39.660 INFO:scrape:Failure: Command failed (workunit test cephadm/test_adoption.sh) on smithi187 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=19c5b8dbbdd59578fd7085156ce8d7836681eed0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' 2022-07-02T19:36:39.662 INFO:scrape:2 jobs: ['6909213', '6909158'] 2022-07-02T19:36:39.662 INFO:scrape:suites intersection: ['orch:cephadm/workunits/{agent/on', 'task/test_adoption}'] 2022-07-02T19:36:39.663 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'orch:cephadm/workunits/{agent/on', 'task/test_adoption}'] 2022-07-02T19:36:39.663 INFO:scrape: 2022-07-02T19:36:39.664 INFO:scrape:Failure: Command failed (workunit test cephadm/test_repos.sh) on smithi032 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=19c5b8dbbdd59578fd7085156ce8d7836681eed0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' 2022-07-02T19:36:39.664 INFO:scrape:1 jobs: ['6909172'] 2022-07-02T19:36:39.665 INFO:scrape:suites: ['mon_election/classic', 'orch:cephadm/workunits/{agent/on', 'task/test_cephadm_repos}'] 2022-07-02T19:36:39.665 INFO:scrape: 2022-07-02T19:36:39.669 INFO:teuthology.results:Sending results to jmulligan@redhat.com: Test Run: phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/ failed: 25 dead: 0 running: 0 waiting: 0 queued: 0 passed: 65 Fail ================================================================= [6909135] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:08:59 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909135/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909135/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0aa112d88abf481181a45f25c0e1c6eb Command failed on smithi176 with status 5: 'sudo systemctl stop ceph-8edd88c8-fa31-11ec-842c-001a4aab830c@mon.smithi176' [6909139] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:11:07 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909139/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909139/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0283b48a42444442a0a6bbc086f154de Command failed on smithi103 with status 5: 'sudo systemctl stop ceph-3d98b0cc-fa32-11ec-842c-001a4aab830c@mon.smithi103' [6909140] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} ----------------------------------------------------------------- time: 00:06:24 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909140/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909140/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c6ce90e383d349a4811c18cf295d6264 Command failed on smithi029 with status 5: 'sudo systemctl stop ceph-1dc02de8-fa32-11ec-842c-001a4aab830c@mon.a' [6909152] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:10:51 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909152/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909152/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a46694502eb04cba928afd395821ee68 Command failed on smithi064 with status 5: 'sudo systemctl stop ceph-5da7ae76-fa33-11ec-842c-001a4aab830c@mon.smithi064' [6909156] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} ----------------------------------------------------------------- time: 00:05:50 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909156/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909156/ sentry: https://sentry.ceph.com/organizations/ceph/?query=58da64f304704e88af2bf1b18530c262 Command failed on smithi172 with status 5: 'sudo systemctl stop ceph-d7181f3e-fa33-11ec-842c-001a4aab830c@mon.a' [6909158] orch:cephadm/workunits/{agent/on mon_election/classic task/test_adoption} ----------------------------------------------------------------- time: 00:07:26 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909158/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909158/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e37499ce68a34265847bdf4d9ec91b12 Command failed (workunit test cephadm/test_adoption.sh) on smithi111 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=19c5b8dbbdd59578fd7085156ce8d7836681eed0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [6909162] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:08:03 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909162/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909162/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1db9776fb969483bafe2665a9bb94f05 Command failed (workunit test cephadm/test_cephadm.sh) on smithi103 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=19c5b8dbbdd59578fd7085156ce8d7836681eed0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [6909167] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:11:08 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909167/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909167/ sentry: https://sentry.ceph.com/organizations/ceph/?query=54efd841444d437c9cb269be484caf69 Command failed on smithi043 with status 5: 'sudo systemctl stop ceph-9c42b05c-fa35-11ec-842c-001a4aab830c@mon.smithi043' [6909168] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} ----------------------------------------------------------------- time: 00:08:09 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909168/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909168/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a4cb69f6195240d9af8b09456fea7552 Command failed on smithi086 with status 5: 'sudo systemctl stop ceph-4ce11f44-fa35-11ec-842c-001a4aab830c@mon.a' [6909169] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:08:29 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909169/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909169/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dfc20bb6f4a74b3bb2bfcd6c9fc24833 Command failed on smithi064 with status 5: 'sudo systemctl stop ceph-5eab067c-fa35-11ec-842c-001a4aab830c@mon.smithi064' [6909172] orch:cephadm/workunits/{agent/on mon_election/classic task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:05:55 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909172/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909172/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6415625c1296429f8005a02649a0b7ad Command failed (workunit test cephadm/test_repos.sh) on smithi032 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=19c5b8dbbdd59578fd7085156ce8d7836681eed0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [6909178] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:11:20 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909178/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909178/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1d9dddec3be14b2cbe6de75ab5fe6ed8 Command failed on smithi026 with status 5: 'sudo systemctl stop ceph-65899a52-fa36-11ec-842c-001a4aab830c@mon.smithi026' [6909180] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} ----------------------------------------------------------------- time: 00:06:19 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909180/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909180/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e5af055ca7ee40af91460672a3b79c75 Command failed on smithi096 with status 5: 'sudo systemctl stop ceph-46dcd574-fa36-11ec-842c-001a4aab830c@mon.a' [6909190] orch:cephadm/workunits/{agent/on mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:37:08 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909190/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909190/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ec48aae6311c44bcad58da2ac1e83cf2 Test failure: test_create_delete_cluster_idempotency (tasks.cephfs.test_nfs.TestNFS) [6909193] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:11:45 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909193/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909193/ sentry: https://sentry.ceph.com/organizations/ceph/?query=844ea7ae92fc47d0b40373fcc4e0f0d5 Command failed on smithi040 with status 5: 'sudo systemctl stop ceph-80bb158e-fa37-11ec-842c-001a4aab830c@mon.smithi040' [6909194] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} ----------------------------------------------------------------- time: 00:07:38 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909194/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909194/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3c98be94c9304971be315e5fd127d664 Command failed on smithi084 with status 5: 'sudo systemctl stop ceph-89b59632-fa37-11ec-842c-001a4aab830c@mon.a' [6909200] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:09:06 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909200/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909200/ sentry: https://sentry.ceph.com/organizations/ceph/?query=898d1da4b68c4b42a4ecded89dea9e9b Command failed on smithi057 with status 5: 'sudo systemctl stop ceph-6310b160-fa37-11ec-842c-001a4aab830c@mon.smithi057' [6909204] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:12:03 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909204/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909204/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8c36d635248b43a8b37179df3554cf7e Command failed on smithi100 with status 5: 'sudo systemctl stop ceph-f117b896-fa37-11ec-842c-001a4aab830c@mon.smithi100' [6909210] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} ----------------------------------------------------------------- time: 00:09:16 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909210/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909210/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3212e2b8e4944792a69cabc4ddc88b72 Command failed on smithi043 with status 5: 'sudo systemctl stop ceph-c410f038-fa37-11ec-842c-001a4aab830c@mon.a' [6909213] orch:cephadm/workunits/{agent/on mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:08:15 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909213/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909213/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bfcaabcc836f4d738f3f5d361d9a9c2e Command failed (workunit test cephadm/test_adoption.sh) on smithi187 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=19c5b8dbbdd59578fd7085156ce8d7836681eed0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [6909217] orch:cephadm/workunits/{agent/off mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:07:39 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909217/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909217/ sentry: https://sentry.ceph.com/organizations/ceph/?query=414baac1e7d54d07ad7a84a1c6254f6e Command failed (workunit test cephadm/test_cephadm.sh) on smithi189 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=19c5b8dbbdd59578fd7085156ce8d7836681eed0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [6909218] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:16:31 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909218/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909218/ Command failed on smithi162 with status 123: "find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" [6909220] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:36:45 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909220/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909220/ Command failed on smithi026 with status 123: "find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" [6909222] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:10:58 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909222/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909222/ sentry: https://sentry.ceph.com/organizations/ceph/?query=61fe581233c248aea1e5bcad2b0490db Command failed on smithi152 with status 5: 'sudo systemctl stop ceph-5bacbbc4-fa39-11ec-842c-001a4aab830c@mon.smithi152' [6909223] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} ----------------------------------------------------------------- time: 00:06:11 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909223/ log: http://qa-proxy.ceph.com/teuthology/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909223/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ff21140c3ca947b5824fecc0cd680179 Command failed on smithi104 with status 5: 'sudo systemctl stop ceph-154713aa-fa39-11ec-842c-001a4aab830c@mon.a' Pass ================================================================= [6909130] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:37:48 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909130/ [6909131] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_nfs} time: 00:32:54 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909131/ [6909132] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:20 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909132/ [6909133] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:20:00 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909133/ [6909134] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:28:08 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909134/ [6909136] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/off orchestrator_cli} time: 00:18:05 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909136/ [6909137] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} time: 00:50:50 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909137/ [6909138] orch:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:17:11 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909138/ [6909141] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:25:03 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909141/ [6909143] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:18:26 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909143/ [6909145] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 01:05:18 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909145/ [6909147] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:39:13 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909147/ [6909148] orch:cephadm/workunits/{agent/on mon_election/classic task/test_orch_cli} time: 00:19:36 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909148/ [6909149] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:24:27 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909149/ [6909150] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:33:54 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909150/ [6909151] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:16:31 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909151/ [6909153] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:16:36 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909153/ [6909154] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:14:55 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909154/ [6909155] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:32:30 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909155/ [6909157] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:37:10 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909157/ [6909159] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:14:48 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909159/ [6909160] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:24:16 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909160/ [6909161] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:15:46 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909161/ [6909163] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:16:09 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909163/ [6909164] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:20:43 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909164/ [6909165] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:37:07 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909165/ [6909166] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:40:07 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909166/ [6909170] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:18:06 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909170/ [6909171] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:27:23 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909171/ [6909173] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:15:38 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909173/ [6909174] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:19:04 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909174/ [6909175] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:17:58 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909175/ [6909176] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:40:12 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909176/ [6909177] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:43:37 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909177/ [6909179] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:15:22 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909179/ [6909181] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:25:08 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909181/ [6909182] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} time: 00:16:08 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909182/ [6909183] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/on orchestrator_cli} time: 00:19:18 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909183/ [6909184] orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:16:30 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909184/ [6909185] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:17:08 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909185/ [6909186] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:15:48 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909186/ [6909187] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 01:01:00 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909187/ [6909188] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:37:52 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909188/ [6909189] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:19:07 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909189/ [6909191] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:18:13 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909191/ [6909192] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:27:56 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909192/ [6909195] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:27:03 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909195/ [6909196] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:21:39 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909196/ [6909197] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:44:32 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909197/ [6909198] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:39:18 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909198/ [6909199] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_orch_cli} time: 00:20:07 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909199/ [6909201] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:54 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909201/ [6909202] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:22:55 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909202/ [6909203] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:32:04 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909203/ [6909205] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:18:02 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909205/ [6909206] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:19:35 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909206/ [6909207] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:40:23 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909207/ [6909212] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:37:28 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909212/ [6909214] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:19:51 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909214/ [6909215] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:33:12 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909215/ [6909216] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:15:23 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909216/ [6909219] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:16:51 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909219/ [6909221] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:40:05 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909221/ [6909224] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:15:34 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909224/ [6909225] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:26:47 info: http://pulpito.ceph.com/phlogistonjohn-2022-07-01_15:52:12-orch:cephadm-wip-phlogistonjohn-testing-2022-06-30-1353-distro-default-smithi/6909225/