2022-06-24T16:26:35.408 INFO:root:teuthology version: 1.1.1.dev376+g082ae7ef 2022-06-24T16:26:35.410 INFO:teuthology.results:subset: '1/999' 2022-06-24T16:26:35.410 INFO:teuthology.results:seed: '7933' 2022-06-24T20:42:53.898 INFO:root:teuthology version: 1.1.1.dev376+g082ae7ef 2022-06-24T20:42:53.942 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-06-25T08:09:48.478 INFO:teuthology.results:Tests finished! gathering results... 2022-06-25T08:09:56.879 INFO:scrape:Found 90 jobs 2022-06-25T08:09:59.112 INFO:scrape:Found 7 distinct failure reasons 2022-06-25T08:09:59.113 INFO:scrape:Dead: b'2022-06-25T04:56:45.550 DEBUG:teuthology.exit:Finished running handlers' 2022-06-25T08:09:59.114 INFO:scrape:2 jobs: ['6897524', '6897579'] 2022-06-25T08:09:59.114 INFO:scrape:suites intersection: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{pg-warn', 'roles', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-06-25T08:09:59.115 INFO:scrape:suites union: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{pg-warn', 'roles', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-06-25T08:09:59.115 INFO:scrape: 2022-06-25T08:09:59.116 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi093 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=29dd75c0755ff6684d288b97415f5da183f786a3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2022-06-25T08:09:59.116 INFO:scrape:1 jobs: ['6897510'] 2022-06-25T08:09:59.116 INFO:scrape:suites: ['orch:cephadm/dashboard/{0-distro/centos_8.stream_container_tools', 'task/test_e2e}'] 2022-06-25T08:09:59.117 INFO:scrape: 2022-06-25T08:09:59.117 INFO:scrape:Failure: Command failed on smithi124 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09ce79e2-f3f8-11ec-842c-001a4aab830c -e sha1=29dd75c0755ff6684d288b97415f5da183f786a3 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2022-06-25T08:09:59.118 INFO:scrape:2 jobs: ['6897572', '6897512'] 2022-06-25T08:09:59.118 INFO:scrape:suites intersection: ['1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools'] 2022-06-25T08:09:59.119 INFO:scrape:suites union: ['1-bootstrap/16.2.4', '1-bootstrap/octopus', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools'] 2022-06-25T08:09:59.119 INFO:scrape: 2022-06-25T08:09:59.120 INFO:scrape:Failure: {'smithi115.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi031.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} 2022-06-25T08:09:59.120 INFO:scrape:14 jobs: ['6897537', '6897523', '6897509', '6897565', '6897530', '6897574', '6897547', '6897586', '6897576', '6897552', '6897514', '6897521', '6897528', '6897582'] 2022-06-25T08:09:59.121 INFO:scrape:suites intersection: [] 2022-06-25T08:09:59.121 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-ops/rm-zap-flag}', '2-ops/rm-zap-wait}', '2-services/iscsi', '2-services/mirror', '2-services/nfs2', '2-services/rgw-ingress', '3-final}', 'cluster/{fixed-3', 'distro/rhel_8.4_container_tools_3.0', 'distro/rhel_8.4_container_tools_rhel8', 'fixed-2', 'mode/packaged', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'openstack}', 'orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8', 'orch:cephadm/rbd_iscsi/{base/install', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8', 'orch:cephadm/smoke/{0-nvme-loop', 'orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8', 'pool/datapool', 'start', 'start}', 'supported-random-distro$/{rhel_8}', 'tasks/rados_api_tests}', 'tasks/rados_python}', 'workloads/ceph_iscsi}'] 2022-06-25T08:09:59.122 INFO:scrape: 2022-06-25T08:09:59.122 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi148.front.sepia.ceph.com: ['type=AVC msg=audit(1656090369.976:6418): avc: denied { ioctl } for pid=58565 comm="iptables" path="/var/lib/containers/storage/overlay/a2acce13b393eb4cf436eb1cdbd3eecd47c8c741eb18a87e19344b6c0b11cdc4/merged" dev="overlay" ino=3803141 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1656090370.086:6421): avc: denied { ioctl } for pid=58582 comm="iptables" path="/var/lib/containers/storage/overlay/a2acce13b393eb4cf436eb1cdbd3eecd47c8c741eb18a87e19344b6c0b11cdc4/merged" dev="overlay" ino=3803141 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] 2022-06-25T08:09:59.122 INFO:scrape:2 jobs: ['6897522', '6897566'] 2022-06-25T08:09:59.123 INFO:scrape:suites intersection: ['orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2022-06-25T08:09:59.123 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2022-06-25T08:09:59.124 INFO:scrape: 2022-06-25T08:09:59.124 INFO:scrape:Failure: Cannot connect to remote host smithi185 2022-06-25T08:09:59.125 INFO:scrape:2 jobs: ['6897577', '6897520'] 2022-06-25T08:09:59.125 INFO:scrape:suites intersection: ['ceph', 'clusters/{openstack', 'distro$/{ubuntu_18.04}', 'rados', 'thrashosds-health', 'three-plus-one}'] 2022-06-25T08:09:59.126 INFO:scrape:suites union: ['1-install/mimic', '1-install/nautilus', 'backoff/normal', 'backoff/peering', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'rados', 'thrashers/default', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/test_rbd_api}'] 2022-06-25T08:09:59.126 INFO:scrape: 2022-06-25T08:09:59.127 INFO:scrape:Failure: {'smithi092.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi155.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} 2022-06-25T08:09:59.127 INFO:scrape:2 jobs: ['6897525', '6897519'] 2022-06-25T08:09:59.128 INFO:scrape:suites intersection: ['0-nvme-loop', '1-start', '3-final}'] 2022-06-25T08:09:59.128 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-services/nfs-ingress-rgw-bucket', '2-services/nfs-ingress-rgw-user', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8'] 2022-06-25T08:09:59.128 INFO:scrape: 2022-06-25T08:09:59.132 INFO:teuthology.results:Sending results to adking@redhat.com: Test Run: adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/ failed: 7 dead: 18 running: 0 waiting: 0 queued: 0 passed: 65 Fail ================================================================= [6897510] orch:cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} ----------------------------------------------------------------- time: 00:18:12 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897510/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897510/ sentry: https://sentry.ceph.com/organizations/ceph/?query=767df0c77f764cef9e56dc8b9e3bb639 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi093 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=29dd75c0755ff6684d288b97415f5da183f786a3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [6897512] orch:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:17:40 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897512/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897512/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0ab19d687fb94414b1e9b0361c1ec00e Command failed on smithi104 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347a71c0-f3dd-11ec-842c-001a4aab830c -e sha1=29dd75c0755ff6684d288b97415f5da183f786a3 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6897520] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897520/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897520/ sentry: https://sentry.ceph.com/organizations/ceph/?query=289ff750817d4c348caf3d64b64abfe7 Cannot connect to remote host smithi008 [6897522] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:12:50 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897522/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897522/ SELinux denials found on ubuntu@smithi148.front.sepia.ceph.com: ['type=AVC msg=audit(1656090369.976:6418): avc: denied { ioctl } for pid=58565 comm="iptables" path="/var/lib/containers/storage/overlay/a2acce13b393eb4cf 436eb1cdbd3eecd47c8c741eb18a87e19344b6c0b11cdc4/merged" dev="overlay" ino=3803141 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1656090370.086:6421): avc: denied { ioctl } for pid=58582 comm="iptables" path="/var/lib/containers/storage/ov erlay/a2acce13b393eb4cf436eb1cdbd3eecd47c8c741eb18a87e19344b6c0b11cdc4/merg ed" dev="overlay" ino=3803141 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [6897566] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:13:13 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897566/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897566/ SELinux denials found on ubuntu@smithi172.front.sepia.ceph.com: ['type=AVC msg=audit(1656100635.086:6421): avc: denied { ioctl } for pid=58774 comm="iptables" path="/var/lib/containers/storage/overlay/08080ffa921349030 f98985147e816927da987645f2c101c932970c070d306f4/merged" dev="overlay" ino=3803102 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1656100635.060:6420): avc: denied { ioctl } for pid=58769 comm="iptables" path="/var/lib/containers/storage/ov erlay/08080ffa921349030f98985147e816927da987645f2c101c932970c070d306f4/merg ed" dev="overlay" ino=3803102 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [6897572] orch:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:19:29 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897572/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897572/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fb978dcc065b4d7b8dfa03cd1078d98b Command failed on smithi124 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09ce79e2-f3f8-11ec-842c-001a4aab830c -e sha1=29dd75c0755ff6684d288b97415f5da183f786a3 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6897577] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897577/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897577/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5d1d8a52679240ab9bea9f76c29794c7 Cannot connect to remote host smithi185 Dead ================================================================= [6897509] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:02:43 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897509/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897509/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e43c0ceb883c4bf08d4da9218f178f7f {'smithi099.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi131.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6897514] orch:cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{rhel_8} workloads/ceph_iscsi} ----------------------------------------------------------------- time: 00:02:44 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897514/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897514/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0c770a72a66f4a108f72f50f6dbd3039 {'smithi067.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi155.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi092.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6897519] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:02:45 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897519/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897519/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ddd90ff70893480f9b557af19a4c561c {'smithi064.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi110.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6897521] orch:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:02:46 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897521/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897521/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ae184bff8b97424095746be523f1715f {'smithi087.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi149.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6897523] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:02:48 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897523/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897523/ sentry: https://sentry.ceph.com/organizations/ceph/?query=79d1b4fa13a5448ea5d629c5ff19e235 {'smithi115.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi031.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6897524] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897524/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897524/ hit max job timeout [6897525] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:02:48 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897525/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897525/ sentry: https://sentry.ceph.com/organizations/ceph/?query=10f8bd3df7534094befdd8f1ad0f2fe8 {'smithi092.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi155.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6897528] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:02:46 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897528/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897528/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f6e23327f85543b4be729e74cf3a1b96 {'smithi045.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi033.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6897530] orch:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:02:44 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897530/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897530/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e9d09ef64d454715858236a13cf55f00 {'smithi110.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi064.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6897537] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:02:44 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897537/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897537/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8c37e2f4d2394070a5585daf0c6c5cc0 {'smithi115.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi031.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6897547] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} ----------------------------------------------------------------- time: 00:02:59 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897547/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897547/ sentry: https://sentry.ceph.com/organizations/ceph/?query=083cb4b006b449d1902d7118424843ee {'smithi044.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi163.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6897552] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:02:59 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897552/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897552/ sentry: https://sentry.ceph.com/organizations/ceph/?query=93e5246a961b4ccdb274874fbd150eaf {'smithi185.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi142.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6897565] orch:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:03:00 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897565/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897565/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4ad682b9b5d94a5d947f7b6f2745594d {'smithi057.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi129.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6897574] orch:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:02:57 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897574/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897574/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4c0d64f1dc6248a181e84b1e1d4cfdfe {'smithi104.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi105.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6897576] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} ----------------------------------------------------------------- time: 00:02:57 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897576/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897576/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2504ca3105474f22aee1501bf446bea4 {'smithi071.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi049.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6897579] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897579/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897579/ hit max job timeout [6897582] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} ----------------------------------------------------------------- time: 00:03:00 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897582/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897582/ sentry: https://sentry.ceph.com/organizations/ceph/?query=99419c9c1bab458791ad66227c5f6ae0 {'smithi064.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi062.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6897586] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:02:56 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897586/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897586/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a707ad267b244fcda9be575a2f54a3a6 {'smithi104.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi105.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} Pass ================================================================= [6897504] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:10:22 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897504/ [6897505] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:34:18 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897505/ [6897506] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:29:31 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897506/ [6897507] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:10:55 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897507/ [6897508] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:28:20 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897508/ [6897511] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:56 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897511/ [6897513] orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr orchestrator_cli} time: 00:10:43 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897513/ [6897515] orch:cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:12:13 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897515/ [6897516] orch:cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:13:44 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897516/ [6897517] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:07:55 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897517/ [6897518] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:50:14 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897518/ [6897526] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:46:10 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897526/ [6897527] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:35:26 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897527/ [6897529] orch:cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:17:48 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897529/ [6897531] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:04:26 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897531/ [6897532] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:51:56 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897532/ [6897533] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:53:33 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897533/ [6897534] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:54 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897534/ [6897535] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:18:07 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897535/ [6897536] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:23:50 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897536/ [6897538] orch:cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:20:21 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897538/ [6897539] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:25:49 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897539/ [6897540] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:51:46 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897540/ [6897541] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:10:54 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897541/ [6897542] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:32:33 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897542/ [6897543] orch:cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:39:54 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897543/ [6897544] orch:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:26:10 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897544/ [6897545] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:03 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897545/ [6897546] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:33:29 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897546/ [6897548] orch:cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:21:33 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897548/ [6897549] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:12:07 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897549/ [6897550] orch:cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:18:43 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897550/ [6897551] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:44:53 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897551/ [6897553] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/classic} time: 00:41:57 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897553/ [6897554] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:56:31 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897554/ [6897555] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:29:43 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897555/ [6897556] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:41 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897556/ [6897557] orch:cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:12:55 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897557/ [6897558] orch:cephadm/smoke-singlehost/{0-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:10:39 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897558/ [6897559] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:08:25 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897559/ [6897560] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} time: 01:28:25 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897560/ [6897561] orch:cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:17:42 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897561/ [6897562] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:35:27 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897562/ [6897563] orch:cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/repave-all} time: 00:15:08 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897563/ [6897564] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:15:32 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897564/ [6897567] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:50:11 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897567/ [6897568] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:53 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897568/ [6897569] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:11:04 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897569/ [6897570] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:29:39 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897570/ [6897571] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:33:14 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897571/ [6897573] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:24:51 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897573/ [6897575] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:05:06 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897575/ [6897578] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:30:52 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897578/ [6897580] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:16:22 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897580/ [6897581] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:38:51 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897581/ [6897583] orch:cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:20:39 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897583/ [6897584] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} time: 00:25:14 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897584/ [6897585] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:34:02 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897585/ [6897587] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:34:48 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897587/ [6897588] orch:cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:17:15 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897588/ [6897589] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:13 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897589/ [6897590] orch:cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:21:42 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897590/ [6897591] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:11:46 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897591/ [6897592] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:51:29 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897592/ [6897593] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:11:20 info: http://pulpito.ceph.com/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897593/