2023-04-06T12:07:33.904 INFO:root:teuthology version: 0.0.1.dev96+g8d156ae 2023-04-06T12:07:33.905 INFO:teuthology.results:subset: '1/13' 2023-04-06T12:07:33.905 INFO:teuthology.results:seed: '5078' 2023-04-06T21:13:20.438 INFO:root:teuthology version: 0.0.1.dev96+g8d156ae 2023-04-06T21:13:20.470 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-04-07T09:14:20.533 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2023-04-07T09:14:28.235 INFO:scrape:Found 98 jobs 2023-04-07T09:14:29.891 INFO:scrape:Found 6 distinct failure reasons 2023-04-07T09:14:29.892 INFO:scrape:Dead: b'2023-04-07T08:35:26.610 DEBUG:teuthology.exit:Finished running handlers' 2023-04-07T09:14:29.892 INFO:scrape:4 jobs: ['7232557', '7232579', '7232488', '7232551'] 2023-04-07T09:14:29.892 INFO:scrape:suites intersection: [] 2023-04-07T09:14:29.893 INFO:scrape:suites union: ['1-bootstrap/16.2.0', '1-bootstrap/16.2.5', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-nfs', '3-inline/no', '3-upgrade-mgr-staggered', '3-upgrade-with-workload', '4-config-upgrade/{fail_fs}', '4-final}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fail_fs/no', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/v16.2.4'] 2023-04-07T09:14:29.893 INFO:scrape: 2023-04-07T09:14:29.893 INFO:scrape:Failure: Command failed on smithi053 with status 2: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1693d076-d487-11ed-9aff-001a4aab830c -e sha1=3b3c6b80426b02bf94ab2c5f2a08f55db494955d -- bash -c \'ceph orch ps --format json | jq --arg TARGET_ID "$TARGET_ID" -e \'"\'"\'.[] | select(.daemon_type=="mgr") | select(.container_image_id==$TARGET_ID)\'"\'"\' | jq -s > out.json\'' 2023-04-07T09:14:29.894 INFO:scrape:2 jobs: ['7232513', '7232574'] 2023-04-07T09:14:29.894 INFO:scrape:suites intersection: ['2-repo_digest/defaut', '3-upgrade/staggered', '4-wait', '5-upgrade-ls', 'agent/on'] 2023-04-07T09:14:29.894 INFO:scrape:suites union: ['2-repo_digest/defaut', '3-upgrade/staggered', '4-wait', '5-upgrade-ls', 'agent/on', 'mon_election/classic}', 'mon_election/connectivity}', 'orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools', 'orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04'] 2023-04-07T09:14:29.895 INFO:scrape: 2023-04-07T09:14:29.895 INFO:scrape:Failure: Command failed on smithi112 with status 1: 'sudo yum install -y kernel' 2023-04-07T09:14:29.895 INFO:scrape:6 jobs: ['7232538', '7232499', '7232503', '7232566', '7232562', '7232565'] 2023-04-07T09:14:29.896 INFO:scrape:suites intersection: [] 2023-04-07T09:14:29.896 INFO:scrape:suites union: ['0-nvme-loop', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '2-services/nfs-keepalive-only', '3-final}', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'agent/off', 'agent/on', 'centos_8.stream_container_tools', 'conf/{client', 'fail_fs/yes', 'fixed-2', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon_election/connectivity', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8', 'orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'start}', 'syntax}', 'task/test_orch_cli_mon}', 'tasks/{0-from/pacific'] 2023-04-07T09:14:29.896 INFO:scrape: 2023-04-07T09:14:29.896 INFO:scrape:Failure: Command failed on smithi181 with status 127: 'sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3b3c6b80426b02bf94ab2c5f2a08f55db494955d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb85168-d497-11ed-9aff-001a4aab830c -- ceph mon dump -f json' 2023-04-07T09:14:29.897 INFO:scrape:1 jobs: ['7232536'] 2023-04-07T09:14:29.897 INFO:scrape:suites: ['fixed-2', 'mode/packaged', 'mon_election/classic', 'msgr/async-v2only', 'orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools', 'start', 'tasks/rotate-keys}'] 2023-04-07T09:14:29.897 INFO:scrape: 2023-04-07T09:14:29.898 INFO:scrape:Failure: ceph version 16.2.11-432.g29156b6f was not installed, found 16.2.11-400.gc1a1fc74.el8. 2023-04-07T09:14:29.898 INFO:scrape:1 jobs: ['7232567'] 2023-04-07T09:14:29.898 INFO:scrape:suites: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fail_fs/yes', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific'] 2023-04-07T09:14:29.898 INFO:scrape: 2023-04-07T09:14:29.899 INFO:scrape:Failure: reached maximum tries (300) after waiting for 300 seconds 2023-04-07T09:14:29.899 INFO:scrape:1 jobs: ['7232535'] 2023-04-07T09:14:29.899 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/jaeger', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun'] 2023-04-07T09:14:29.900 INFO:scrape: 2023-04-07T09:14:29.903 INFO:teuthology.results:Sending results to adking@redhat.com: Test Run: adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/ failed: 11 dead: 3 running: 1 waiting: 0 queued: 0 passed: 83 Fail ================================================================= [7232499] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} ----------------------------------------------------------------- time: 00:17:40 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232499/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232499/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e5cbfe7dfd7144d5a51a4de606f9ffe0 Command failed on smithi093 with status 32: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'mount -t nfs 10.0.31.93:/fake /mnt/foo'" [7232503] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232503/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232503/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b05109db42854dc8a895ba1753a099c7 Command failed on smithi031 with status 1: 'sudo yum install -y kernel' [7232513] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} ----------------------------------------------------------------- time: 00:35:09 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232513/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232513/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e356d535ea7342d6815aae0839e34efc Command failed on smithi053 with status 2: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1693d076-d487-11ed-9aff-001a4aab830c -e sha1=3b3c6b80426b02bf94ab2c5f2a08f55db494955d -- bash -c \'ceph orch ps --format json | jq --arg TARGET_ID "$TARGET_ID" -e \'"\'"\'.[] | select(.daemon_type=="mgr") | select(.container_image_id==$TARGET_ID)\'"\'"\' | jq -s > out.json\'' [7232535] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:44:36 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232535/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232535/ sentry: https://sentry.ceph.com/organizations/ceph/?query=02664e91dfae43ac91a227f26b53e591 reached maximum tries (300) after waiting for 300 seconds [7232536] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} ----------------------------------------------------------------- time: 01:14:02 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232536/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232536/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4e17898af93f4a8eb50d747e29ef3335 Command failed on smithi181 with status 127: 'sudo cephadm --image quay- quay-quay.apps.os.sepia.ceph.com/ceph- ci/ceph:3b3c6b80426b02bf94ab2c5f2a08f55db494955d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb85168-d497-11ed-9aff-001a4aab830c -- ceph mon dump -f json' [7232538] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232538/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232538/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5d578e32e0ff4b8ca8e5f31f899962d4 Command failed on smithi112 with status 1: 'sudo yum install -y kernel' [7232562] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} ----------------------------------------------------------------- time: 00:20:50 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232562/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232562/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0b5aa16437bb44769a206407acf4c76b Command failed on smithi057 with status 32: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'mount -t nfs 10.0.31.57:/fake /mnt/foo'" [7232565] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232565/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232565/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5f0087b312964469acdea95837d1ece1 Command failed on smithi005 with status 1: 'sudo yum install -y kernel' [7232566] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232566/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232566/ sentry: https://sentry.ceph.com/organizations/ceph/?query=32c2aac7c88740bcadaae85b7c347bda Command failed on smithi110 with status 1: 'sudo yum install -y kernel' [7232567] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 01:11:44 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232567/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232567/ sentry: https://sentry.ceph.com/organizations/ceph/?query=32bb868e54234475bd6ddf3a32a7b7d7 ceph version 16.2.11-432.g29156b6f was not installed, found 16.2.11-400.gc1a1fc74.el8. [7232574] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} ----------------------------------------------------------------- time: 00:23:36 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232574/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232574/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cefea7b320ec43d196bf600509968be8 Command failed on smithi057 with status 2: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 36e60112-d4c0-11ed-9aff-001a4aab830c -e sha1=3b3c6b80426b02bf94ab2c5f2a08f55db494955d -- bash -c \'ceph orch ps --format json | jq --arg TARGET_ID "$TARGET_ID" -e \'"\'"\'.[] | select(.daemon_type=="mgr") | select(.container_image_id==$TARGET_ID)\'"\'"\' | jq -s > out.json\'' Dead ================================================================= [7232488] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232488/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232488/ hit max job timeout [7232551] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232551/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232551/ hit max job timeout [7232557] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232557/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232557/ hit max job timeout Running ================================================================= [7232579] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232579/ Pass ================================================================= [7232485] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:30:19 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232485/ [7232486] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 01:01:01 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232486/ [7232487] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_nfs} time: 00:35:02 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232487/ [7232489] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli} time: 00:17:38 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232489/ [7232490] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} time: 02:01:32 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232490/ [7232491] orch:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:17:30 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232491/ [7232492] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:26:27 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232492/ [7232493] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} time: 00:37:39 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232493/ [7232494] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:34:09 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232494/ [7232495] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:18:51 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232495/ [7232496] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:16:50 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232496/ [7232497] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:16:52 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232497/ [7232498] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli} time: 01:15:06 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232498/ [7232500] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 01:27:30 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232500/ [7232501] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 01:32:21 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232501/ [7232502] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 01:38:21 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232502/ [7232504] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:19:11 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232504/ [7232505] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 01:25:51 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232505/ [7232506] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:27:40 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232506/ [7232507] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:15:54 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232507/ [7232508] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:25:21 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232508/ [7232509] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_rgw_multisite} time: 00:19:02 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232509/ [7232510] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 01:38:09 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232510/ [7232511] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:31:14 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232511/ [7232512] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 01:31:29 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232512/ [7232514] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:28:31 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232514/ [7232515] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_set_mon_crush_locations} time: 00:20:25 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232515/ [7232516] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:26:40 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232516/ [7232517] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:18:42 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232517/ [7232518] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:14:30 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232518/ [7232519] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:29:01 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232519/ [7232520] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:14:45 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232520/ [7232521] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:39:23 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232521/ [7232522] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:39:30 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232522/ [7232523] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_adoption} time: 00:14:32 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232523/ [7232524] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:54:43 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232524/ [7232525] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:18:34 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232525/ [7232526] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 01:31:55 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232526/ [7232527] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm} time: 00:18:30 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232527/ [7232528] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:31:07 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232528/ [7232529] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:28:35 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232529/ [7232530] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:50:25 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232530/ [7232531] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:33:14 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232531/ [7232532] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:24 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232532/ [7232533] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:28:54 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232533/ [7232534] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm_repos} time: 00:22:17 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232534/ [7232537] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:16:46 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232537/ [7232539] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 01:14:59 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232539/ [7232540] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_3.0} 2-node-mgr agent/on orchestrator_cli} time: 00:17:25 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232540/ [7232541] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} time: 00:26:57 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232541/ [7232542] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:27:07 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232542/ [7232543] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:45:55 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232543/ [7232544] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 01:37:54 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232544/ [7232545] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:17:30 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232545/ [7232546] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:27:56 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232546/ [7232547] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:17:47 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232547/ [7232548] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_monitoring_stack_basic} time: 00:24:08 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232548/ [7232549] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:20:43 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232549/ [7232550] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:29:01 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232550/ [7232552] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:30:03 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232552/ [7232553] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 01:36:46 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232553/ [7232554] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:42:15 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232554/ [7232555] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_nfs} time: 00:30:22 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232555/ [7232556] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:27:08 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232556/ [7232558] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:29:59 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232558/ [7232559] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:27:31 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232559/ [7232560] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:16:29 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232560/ [7232561] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli} time: 00:18:29 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232561/ [7232563] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 01:38:40 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232563/ [7232564] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:43:33 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232564/ [7232568] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:16:43 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232568/ [7232569] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 01:26:18 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232569/ [7232570] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:18:29 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232570/ [7232571] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:06 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232571/ [7232572] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:25:07 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232572/ [7232573] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_rgw_multisite} time: 01:22:05 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232573/ [7232575] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:52:07 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232575/ [7232576] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:31:25 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232576/ [7232577] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} time: 01:25:00 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232577/ [7232578] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_set_mon_crush_locations} time: 00:21:21 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232578/ [7232580] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:29:55 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232580/ [7232581] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:15:50 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232581/ [7232582] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:29:17 info: http://pulpito.ceph.com/adking-2023-04-05_05:00:01-orch:cephadm-wip-adk-testing-2023-04-04-2123-distro-default-smithi/7232582/