2024-02-01T21:28:05.760 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-02-01T21:28:05.761 INFO:teuthology.results:subset: '111/120000' 2024-02-01T21:28:05.761 INFO:teuthology.results:seed: '8849' 2024-02-02T02:15:37.134 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-02-02T02:15:37.161 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-02-02T05:13:55.095 INFO:teuthology.results:Tests finished! gathering results... 2024-02-02T05:14:27.897 INFO:scrape:Found 428 jobs 2024-02-02T05:14:31.127 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542500/teuthology.log 2024-02-02T05:14:39.335 INFO:scrape:Found 11 distinct failure reasons 2024-02-02T05:14:39.335 INFO:scrape:Failure: timeout expired in wait_until_healthy 2024-02-02T05:14:39.335 INFO:scrape:3 jobs: ['7542603', '7542695', '7542821'] 2024-02-02T05:14:39.335 INFO:scrape:suites intersection: [] 2024-02-02T05:14:39.336 INFO:scrape:suites union: ['1-bootstrap/octopus', '1-ranks/1', '1-start', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '2-nfs', '2-repo_digest/defaut', '3-inline/yes', '3-upgrade-with-workload', '3-upgrade/simple', '4-final}', '4-verify}', '4-verify}}', '4-wait', '5-upgrade-ls', 'centos_8.stream_container_tools', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon_election/classic}', 'osd}', 'overrides/{ignorelist_health', 'pg-warn}', 'rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9', 'roles', 'tasks/{0-from/v16.2.4'] 2024-02-02T05:14:39.336 INFO:scrape: 2024-02-02T05:14:39.336 INFO:scrape:Failure: Command failed on smithi119 with status 5: 'sudo systemctl stop ceph-68b120d6-c16a-11ee-95b6-87774f69a715@mon.smithi119' 2024-02-02T05:14:39.336 INFO:scrape:10 jobs: ['7542738', '7542768', '7542714', '7542785', '7542679', '7542654', '7542631', '7542815', '7542677', '7542752'] 2024-02-02T05:14:39.336 INFO:scrape:suites intersection: ['3-upgrade-with-workload'] 2024-02-02T05:14:39.336 INFO:scrape:suites union: ['1-bootstrap/16.2.4', '1-bootstrap/16.2.5', '1-ranks/1', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-nfs', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '4-final}', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn}', 'rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools', 'roles', 'tasks/{0-from/v16.2.4'] 2024-02-02T05:14:39.336 INFO:scrape: 2024-02-02T05:14:39.337 INFO:scrape:Failure: reached maximum tries (301) after waiting for 300 seconds 2024-02-02T05:14:39.337 INFO:scrape:9 jobs: ['7542702', '7542805', '7542780', '7542825', '7542625', '7542652', '7542814', '7542641', '7542611'] 2024-02-02T05:14:39.337 INFO:scrape:suites intersection: ['0-nvme-loop', '1-start', '3-final}'] 2024-02-02T05:14:39.337 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-services/nfs-ingress', '2-services/nfs-ingress-rgw-bucket', '2-services/nfs-ingress-rgw-user', '2-services/nfs-ingress2', '2-services/rgw-ingress', '3-final}', 'rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0', 'rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8', 'rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04', 'rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04'] 2024-02-02T05:14:39.337 INFO:scrape: 2024-02-02T05:14:39.337 INFO:scrape:Failure: Command failed on smithi129 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 54df4d9e-c14c-11ee-95b6-87774f69a715 -e sha1=9d3bfcd6bbd6e928b02e16b0928094f25d96c0a1 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2024-02-02T05:14:39.337 INFO:scrape:4 jobs: ['7542413', '7542480', '7542610', '7542793'] 2024-02-02T05:14:39.337 INFO:scrape:suites intersection: [] 2024-02-02T05:14:39.338 INFO:scrape:suites union: ['1-bootstrap/octopus', '1-start', '2-nfs', '2-repo_digest/defaut', '3-upgrade-with-workload', '3-upgrade/simple', '3-upgrade/staggered', '4-final}', '4-wait', '5-upgrade-ls', 'mon_election/classic}', 'mon_election/connectivity}', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools', 'rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04'] 2024-02-02T05:14:39.338 INFO:scrape: 2024-02-02T05:14:39.338 INFO:scrape:Failure: 'package_manager_version' 2024-02-02T05:14:39.338 INFO:scrape:2 jobs: ['7542469', '7542685'] 2024-02-02T05:14:39.338 INFO:scrape:suites intersection: ['cluster/{fixed-3', 'openstack}', 'pool/datapool', 'rados/cephadm/rbd_iscsi/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/ceph_iscsi}'] 2024-02-02T05:14:39.338 INFO:scrape:suites union: ['cluster/{fixed-3', 'openstack}', 'pool/datapool', 'rados/cephadm/rbd_iscsi/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/ceph_iscsi}'] 2024-02-02T05:14:39.338 INFO:scrape: 2024-02-02T05:14:39.338 INFO:scrape:Dead: None 2024-02-02T05:14:39.338 INFO:scrape:1 jobs: ['7542500'] 2024-02-02T05:14:39.338 INFO:scrape: 2024-02-02T05:14:39.338 INFO:scrape:Failure: "2024-02-01T23:27:26.070425+0000 mon.a (mon.0) 471 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log 2024-02-02T05:14:39.339 INFO:scrape:3 jobs: ['7542543', '7542800', '7542447'] 2024-02-02T05:14:39.339 INFO:scrape:suites intersection: ['clusters/{fixed-2', 'mon_election/classic', 'msgr-failures/few', 'openstack}', 'rados'] 2024-02-02T05:14:39.339 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/verify/{centos_latest', 'supported-random-distro$/{centos_8}', 'tasks/rados_cls_all', 'tasks/rados_cls_all}', 'validater/lockdep}'] 2024-02-02T05:14:39.339 INFO:scrape: 2024-02-02T05:14:39.339 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi142 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9d3bfcd6bbd6e928b02e16b0928094f25d96c0a1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2024-02-02T05:14:39.339 INFO:scrape:2 jobs: ['7542705', '7542810'] 2024-02-02T05:14:39.339 INFO:scrape:suites intersection: ['rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2024-02-02T05:14:39.339 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2024-02-02T05:14:39.339 INFO:scrape: 2024-02-02T05:14:39.339 INFO:scrape:Failure: Command failed (workunit test mon/crush_ops.sh) on smithi151 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9d3bfcd6bbd6e928b02e16b0928094f25d96c0a1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/crush_ops.sh' 2024-02-02T05:14:39.340 INFO:scrape:2 jobs: ['7542760', '7542501'] 2024-02-02T05:14:39.340 INFO:scrape:suites intersection: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/mon-delay', 'msgr/async', 'rados', 'rados/monthrash/{ceph', 'workloads/rados_mon_workunits}'] 2024-02-02T05:14:39.340 INFO:scrape:suites union: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/mon-delay', 'msgr/async', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/many', 'thrashers/one', 'workloads/rados_mon_workunits}'] 2024-02-02T05:14:39.340 INFO:scrape: 2024-02-02T05:14:39.340 INFO:scrape:Failure: Failed to reconnect to smithi076 2024-02-02T05:14:39.340 INFO:scrape:2 jobs: ['7542806', '7542697'] 2024-02-02T05:14:39.340 INFO:scrape:suites intersection: ['mon_election/classic'] 2024-02-02T05:14:39.340 INFO:scrape:suites union: ['1-install/nautilus-v1only', 'backoff/peering', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'distro$/{ubuntu_18.04}', 'fixed-2', 'mode/packaged', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v1only', 'rados', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/cephadm/with-work/{0-distro/ubuntu_18.04', 'start', 'tasks/rados_api_tests}', 'thrashers/careful', 'thrashosds-health', 'three-plus-one}', 'workloads/snaps-few-objects}'] 2024-02-02T05:14:39.340 INFO:scrape: 2024-02-02T05:14:39.340 INFO:scrape:Failure: Command failed on smithi022 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d3bfcd6bbd6e928b02e16b0928094f25d96c0a1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 55e6deae-c15c-11ee-95b6-87774f69a715 -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' 2024-02-02T05:14:39.341 INFO:scrape:1 jobs: ['7542594'] 2024-02-02T05:14:39.341 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-ops/rm-zap-add}', 'rados/cephadm/osds/{0-distro/ubuntu_18.04'] 2024-02-02T05:14:39.341 INFO:scrape: 2024-02-02T05:14:39.361 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/ failed: 38 dead: 1 running: 0 waiting: 0 queued: 0 passed: 389 Fail ================================================================= [7542413] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} ----------------------------------------------------------------- time: 00:23:32 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542413/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542413/ sentry: https://sentry.ceph.com/organizations/ceph/?query=20609f3cab7b44cfa2dff290febbd15e Command failed on smithi129 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 54df4d9e-c14c-11ee-95b6-87774f69a715 -e sha1=9d3bfcd6bbd6e928b02e16b0928094f25d96c0a1 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [7542447] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_cls_all} ----------------------------------------------------------------- time: 00:17:03 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542447/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542447/ "2024-02-01T22:28:56.066825+0000 mon.a (mon.0) 465 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log [7542469] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} ----------------------------------------------------------------- time: 00:12:12 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542469/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542469/ sentry: https://sentry.ceph.com/organizations/ceph/?query=577165eb7b844bcfb8eddd99ce7b14a1 'package_manager_version' [7542480] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} ----------------------------------------------------------------- time: 00:21:32 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542480/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542480/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f073f26c00cc413cb395e66f8a74667e Command failed on smithi091 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid daba4df0-c152-11ee-95b6-87774f69a715 -e sha1=9d3bfcd6bbd6e928b02e16b0928094f25d96c0a1 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [7542501] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 00:15:09 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542501/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542501/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3d42eb67209b45a1973a4a1ebcfc7197 Command failed (workunit test mon/crush_ops.sh) on smithi179 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9d3bfcd6bbd6e928b02e16b0928094f25d96c0a1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/crush_ops.sh' [7542543] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:17:51 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542543/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542543/ "2024-02-01T23:27:26.070425+0000 mon.a (mon.0) 471 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log [7542594] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:15:50 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542594/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542594/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1820dd8c011640c5831d2a98523fce31 Command failed on smithi022 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:9d3bfcd6bbd6e928b02e16b0928094f25d96c0a1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 55e6deae-c15c-11ee-95b6-87774f69a715 -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' [7542603] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:32:56 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542603/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542603/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6c19dcc934944c48952863cafbafa938 timeout expired in wait_until_healthy [7542610] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:22:02 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542610/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542610/ sentry: https://sentry.ceph.com/organizations/ceph/?query=19eca13e1af545f9b8ab2bbf3b50c0b0 Command failed on smithi012 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 291b9048-c15e-11ee-95b6-87774f69a715 -e sha1=9d3bfcd6bbd6e928b02e16b0928094f25d96c0a1 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [7542611] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:43:29 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542611/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542611/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b2b40a07e5264272a40a3648f6628ab0 reached maximum tries (301) after waiting for 300 seconds [7542625] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:40:33 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542625/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542625/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8c59ef6ef4b148dba9eb109e80cdaefc reached maximum tries (301) after waiting for 300 seconds [7542631] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:25:55 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542631/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542631/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f6d28caf1adc4413834dfd249eceab70 Command failed on smithi121 with status 5: 'sudo systemctl stop ceph-7fba7efc-c161-11ee-95b6-87774f69a715@mon.smithi121' [7542641] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:36:01 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542641/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542641/ sentry: https://sentry.ceph.com/organizations/ceph/?query=779ad1d741714d84b5e6412928c3fdd0 reached maximum tries (301) after waiting for 300 seconds [7542652] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:40:12 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542652/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542652/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fd4d88a04c40427798f160dc839921fc reached maximum tries (301) after waiting for 300 seconds [7542654] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:26:16 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542654/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542654/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c9aae798242e4ad8aeb8c01ec0f318f0 Command failed on smithi159 with status 5: 'sudo systemctl stop ceph-31e82cea-c163-11ee-95b6-87774f69a715@mon.smithi159' [7542677] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:25:51 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542677/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542677/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4af6159351c044cd9d26fe7e6e8b7908 Command failed on smithi150 with status 5: 'sudo systemctl stop ceph-d7cff182-c164-11ee-95b6-87774f69a715@mon.smithi150' [7542679] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:22:48 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542679/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542679/ sentry: https://sentry.ceph.com/organizations/ceph/?query=403a6be13b39426e95a246c58a326b30 Command failed on smithi194 with status 5: 'sudo systemctl stop ceph- eb414cac-c164-11ee-95b6-87774f69a715@mon.smithi194' [7542685] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} ----------------------------------------------------------------- time: 00:12:07 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542685/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542685/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0a489b56f78745328e375d84e99d5d89 'package_manager_version' [7542695] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} ----------------------------------------------------------------- time: 00:19:46 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542695/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542695/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8044d50b9e914b7bbf23cff79ab5915d timeout expired in wait_until_healthy [7542697] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542697/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542697/ sentry: https://sentry.ceph.com/organizations/ceph/?query=288595507a1742f08b64c1841d51cc8e Failed to reconnect to smithi111 [7542702] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:45:10 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542702/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542702/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1346640089964edc8fbdd8f4126d382a reached maximum tries (301) after waiting for 300 seconds [7542705] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:18:09 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542705/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542705/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ff3603c38e6a4da0ae03faa3bcbeb42c Command failed (workunit test cephadm/test_cephadm.sh) on smithi142 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9d3bfcd6bbd6e928b02e16b0928094f25d96c0a1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [7542714] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:26:03 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542714/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542714/ sentry: https://sentry.ceph.com/organizations/ceph/?query=773057aa776645bb91e64ee2e4d462d5 Command failed on smithi191 with status 5: 'sudo systemctl stop ceph-b44ffe38-c168-11ee-95b6-87774f69a715@mon.smithi191' [7542738] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:26:35 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542738/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542738/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fdf4a87f86864dafb2e31af62688abcf Command failed on smithi119 with status 5: 'sudo systemctl stop ceph-68b120d6-c16a-11ee-95b6-87774f69a715@mon.smithi119' [7542752] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:23:07 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542752/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542752/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eedb452d50314b45b81225fad0bc2b4b Command failed on smithi148 with status 5: 'sudo systemctl stop ceph-3c346454-c16b-11ee-95b6-87774f69a715@mon.smithi148' [7542760] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 00:24:51 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542760/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542760/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e86f784a3df049be8f7fb4ca434a91b7 Command failed (workunit test mon/crush_ops.sh) on smithi151 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9d3bfcd6bbd6e928b02e16b0928094f25d96c0a1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/crush_ops.sh' [7542768] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:26:48 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542768/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542768/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d88ce15de39944cea296e156a1b9dcec Command failed on smithi135 with status 5: 'sudo systemctl stop ceph-014d589e-c16d-11ee-95b6-87774f69a715@mon.smithi135' [7542780] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:37:39 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542780/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542780/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4a7d7988b9c64d099dc260ec86a958e6 reached maximum tries (301) after waiting for 300 seconds [7542785] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:26:28 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542785/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542785/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f05ea86643da47cd923759cb221d1337 Command failed on smithi097 with status 5: 'sudo systemctl stop ceph-21d7baa8-c16f-11ee-95b6-87774f69a715@mon.smithi097' [7542793] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/classic} ----------------------------------------------------------------- time: 00:39:44 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542793/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542793/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a6f961a24887425aa97df2f228dede5c Command failed on smithi016 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4cbce59a-c16f-11ee-95b6-87774f69a715 -e sha1=9d3bfcd6bbd6e928b02e16b0928094f25d96c0a1 -- bash -c \'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.x | awk \'"\'"\'{print $2}\'"\'"\')\'' [7542800] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:18:02 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542800/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542800/ "2024-02-02T02:15:01.439000+0000 mon.a (mon.0) 467 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log [7542805] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:42:12 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542805/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542805/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dcb33b1b25cf4c55b0beb21518371611 reached maximum tries (301) after waiting for 300 seconds [7542806] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542806/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542806/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9380b59c080245329e415384414c690d Failed to reconnect to smithi076 [7542810] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:18:04 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542810/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542810/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a251bf14dbae40c48020f63d6de4ded7 Command failed (workunit test cephadm/test_cephadm.sh) on smithi107 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9d3bfcd6bbd6e928b02e16b0928094f25d96c0a1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [7542814] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:44:06 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542814/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542814/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9037c7c02073429cbccd53b4a67ea8a9 reached maximum tries (301) after waiting for 300 seconds [7542815] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:25:58 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542815/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542815/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d366e00370354e01a48862370acebb07 Command failed on smithi196 with status 5: 'sudo systemctl stop ceph-f99f748c-c172-11ee-95b6-87774f69a715@mon.smithi196' [7542821] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:27:37 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542821/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542821/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c0d58802067c486eb945ead9bf57fede timeout expired in wait_until_healthy [7542825] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:40:23 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542825/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542825/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6831da64eae1445283fc32cd7283ec7f reached maximum tries (301) after waiting for 300 seconds Dead ================================================================= [7542500] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542500/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542500/ Error reimaging machines: Failed to power on smithi073 Pass ================================================================= [7542401] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:37:27 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542401/ [7542402] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:20:09 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542402/ [7542403] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:39:12 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542403/ [7542404] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.6_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:17:47 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542404/ [7542405] rados/objectstore/{backends/objectstore supported-random-distro$/{centos_8}} time: 05:13:41 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542405/ [7542406] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:14:39 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542406/ [7542407] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:14:52 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542407/ [7542408] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:15:07 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542408/ [7542409] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:20:37 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542409/ [7542410] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:18:33 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542410/ [7542411] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench} time: 00:53:20 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542411/ [7542412] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:30 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542412/ [7542414] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:10:28 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542414/ [7542415] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:49:12 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542415/ [7542416] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:27:04 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542416/ [7542417] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} time: 00:33:31 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542417/ [7542418] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:24:21 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542418/ [7542419] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:27 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542419/ [7542420] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:08:57 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542420/ [7542421] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:35:51 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542421/ [7542422] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:16:09 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542422/ [7542423] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:17 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542423/ [7542424] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:26:16 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542424/ [7542425] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:21 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542425/ [7542426] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:27:51 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542426/ [7542427] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:21:53 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542427/ [7542428] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:17:46 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542428/ [7542429] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:51:16 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542429/ [7542430] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:25:26 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542430/ [7542431] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:39:48 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542431/ [7542432] rados/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:33:53 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542432/ [7542433] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:25:22 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542433/ [7542434] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:15:11 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542434/ [7542435] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:13:21 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542435/ [7542436] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:18:12 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542436/ [7542437] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:11:25 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542437/ [7542438] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:34:43 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542438/ [7542439] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:21:12 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542439/ [7542440] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:16:10 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542440/ [7542441] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:22 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542441/ [7542442] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:52:22 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542442/ [7542443] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:33:43 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542443/ [7542444] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:23:12 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542444/ [7542445] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:42 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542445/ [7542446] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_set_object} time: 00:12:12 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542446/ [7542448] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} time: 00:27:36 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542448/ [7542449] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:27:33 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542449/ [7542450] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:11:11 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542450/ [7542451] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:19:55 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542451/ [7542452] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-stupid} tasks/dashboard} time: 00:55:38 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542452/ [7542453] rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} time: 00:11:02 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542453/ [7542454] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} time: 00:15:17 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542454/ [7542455] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:19:59 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542455/ [7542456] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} time: 00:21:27 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542456/ [7542457] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_18.04} time: 02:55:44 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542457/ [7542458] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:25:03 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542458/ [7542459] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} time: 00:24:32 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542459/ [7542460] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:28 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542460/ [7542461] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:26:57 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542461/ [7542462] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:24:54 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542462/ [7542463] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:32:05 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542463/ [7542464] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:27:52 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542464/ [7542465] rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr orchestrator_cli} time: 00:14:04 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542465/ [7542466] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/prometheus} time: 00:12:57 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542466/ [7542467] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:21:52 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542467/ [7542468] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:31:44 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542468/ [7542470] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:51 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542470/ [7542471] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:21:46 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542471/ [7542472] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:17:15 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542472/ [7542473] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:12:06 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542473/ [7542474] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:18:51 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542474/ [7542475] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:12:45 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542475/ [7542476] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:30:54 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542476/ [7542477] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:19:48 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542477/ [7542478] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:38:12 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542478/ [7542479] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:26:38 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542479/ [7542481] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:22:30 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542481/ [7542482] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:59 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542482/ [7542483] rados/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:42:21 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542483/ [7542484] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_python} time: 00:19:30 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542484/ [7542485] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:12:37 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542485/ [7542486] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:27 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542486/ [7542487] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:33:48 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542487/ [7542488] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:25:43 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542488/ [7542489] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:13:22 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542489/ [7542490] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:22:33 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542490/ [7542491] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} time: 00:17:54 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542491/ [7542492] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:36 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542492/ [7542493] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:18:28 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542493/ [7542494] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:18:25 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542494/ [7542495] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.6_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:21:46 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542495/ [7542496] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:58:08 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542496/ [7542497] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:21:45 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542497/ [7542498] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:34:51 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542498/ [7542499] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:11:13 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542499/ [7542502] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} time: 00:23:09 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542502/ [7542503] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:53:51 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542503/ [7542504] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:17:08 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542504/ [7542505] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:07:29 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542505/ [7542506] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/workunits} time: 00:11:18 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542506/ [7542507] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:53 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542507/ [7542508] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:40 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542508/ [7542509] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:50:03 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542509/ [7542510] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:09:09 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542510/ [7542511] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 00:42:50 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542511/ [7542512] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:34:51 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542512/ [7542513] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:29:02 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542513/ [7542514] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:35:41 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542514/ [7542515] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.6_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:18:57 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542515/ [7542516] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:16:34 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542516/ [7542517] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} time: 00:20:57 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542517/ [7542518] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:15:49 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542518/ [7542519] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:49 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542519/ [7542520] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:10:31 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542520/ [7542521] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:26:35 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542521/ [7542522] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:33:52 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542522/ [7542523] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:35:06 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542523/ [7542524] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:08 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542524/ [7542525] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:36 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542525/ [7542526] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:51:16 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542526/ [7542527] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:12:13 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542527/ [7542528] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:34:45 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542528/ [7542529] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:23:31 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542529/ [7542530] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:18:35 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542530/ [7542531] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:16 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542531/ [7542532] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} time: 00:26:50 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542532/ [7542533] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:26:45 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542533/ [7542534] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:21:21 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542534/ [7542535] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:18:28 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542535/ [7542536] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:35:05 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542536/ [7542537] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:20:22 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542537/ [7542538] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:30:54 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542538/ [7542539] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:27:10 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542539/ [7542540] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:16:37 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542540/ [7542541] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:23 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542541/ [7542542] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:34:13 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542542/ [7542544] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/one workloads/snaps-few-objects} time: 00:45:13 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542544/ [7542545] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:16:14 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542545/ [7542546] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:10:36 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542546/ [7542547] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:22:18 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542547/ [7542548] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:42:22 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542548/ [7542549] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:10:05 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542549/ [7542550] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:31:59 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542550/ [7542551] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:15:36 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542551/ [7542552] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:11:06 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542552/ [7542553] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 01:05:28 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542553/ [7542554] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:58 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542554/ [7542555] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:02 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542555/ [7542556] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:15:38 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542556/ [7542557] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:19 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542557/ [7542558] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:22:28 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542558/ [7542559] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:29:33 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542559/ [7542560] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:12:37 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542560/ [7542561] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:18:09 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542561/ [7542562] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli_mon} time: 00:30:11 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542562/ [7542563] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} time: 00:20:32 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542563/ [7542564] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 01:44:16 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542564/ [7542565] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:34:09 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542565/ [7542566] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:51:30 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542566/ [7542567] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:17:25 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542567/ [7542568] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:13:33 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542568/ [7542569] rados/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} time: 00:23:35 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542569/ [7542570] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:43:53 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542570/ [7542571] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:35:52 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542571/ [7542572] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:16 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542572/ [7542573] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:22:33 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542573/ [7542574] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:17:28 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542574/ [7542575] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_18.04} 1-start 2-services/rgw 3-final} time: 00:16:10 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542575/ [7542576] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:41:30 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542576/ [7542577] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:15:33 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542577/ [7542578] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:12:04 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542578/ [7542579] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} time: 00:35:31 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542579/ [7542580] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:32:02 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542580/ [7542581] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:22:08 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542581/ [7542582] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:25:52 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542582/ [7542583] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:32:07 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542583/ [7542584] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:12:12 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542584/ [7542585] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:33:36 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542585/ [7542586] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:10:35 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542586/ [7542587] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/pool-create-delete} time: 00:25:17 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542587/ [7542588] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:12:19 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542588/ [7542589] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:21:30 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542589/ [7542590] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:17:02 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542590/ [7542591] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:33:25 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542591/ [7542592] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:16:00 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542592/ [7542593] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:29:21 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542593/ [7542595] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:19:19 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542595/ [7542596] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} time: 00:17:14 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542596/ [7542597] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:48 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542597/ [7542598] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:42:50 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542598/ [7542599] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:24:23 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542599/ [7542600] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.6_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:21:09 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542600/ [7542601] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:30:05 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542601/ [7542602] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:19:02 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542602/ [7542604] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:22:27 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542604/ [7542605] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:24:57 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542605/ [7542606] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:07:31 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542606/ [7542607] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:34:17 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542607/ [7542608] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:16:41 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542608/ [7542609] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:36:24 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542609/ [7542612] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:30 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542612/ [7542613] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} time: 00:21:29 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542613/ [7542614] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} time: 00:31:45 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542614/ [7542615] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:37:30 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542615/ [7542616] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:21:09 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542616/ [7542617] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:38:14 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542617/ [7542618] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:28:49 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542618/ [7542619] rados/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:44:34 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542619/ [7542620] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:20:42 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542620/ [7542621] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.6_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:18:27 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542621/ [7542622] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:18:37 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542622/ [7542623] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:15:27 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542623/ [7542624] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:17:55 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542624/ [7542626] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:18:27 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542626/ [7542627] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:24:51 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542627/ [7542628] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:22:09 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542628/ [7542629] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:11:34 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542629/ [7542630] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:17 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542630/ [7542632] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_5925} time: 00:21:11 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542632/ [7542633] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:08:56 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542633/ [7542634] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:47:12 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542634/ [7542635] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 02:15:16 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542635/ [7542636] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:26:31 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542636/ [7542637] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:21:02 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542637/ [7542638] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:18:39 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542638/ [7542639] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:21:24 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542639/ [7542640] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache} time: 00:12:45 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542640/ [7542642] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:41:57 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542642/ [7542643] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:48:36 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542643/ [7542644] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} time: 02:26:45 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542644/ [7542645] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:29:38 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542645/ [7542646] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:12:32 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542646/ [7542647] rados/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:30:40 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542647/ [7542648] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:22:56 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542648/ [7542649] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:11:26 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542649/ [7542650] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:14:56 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542650/ [7542651] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:41:16 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542651/ [7542653] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:39:42 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542653/ [7542655] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:34:00 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542655/ [7542656] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:21:18 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542656/ [7542657] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:30 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542657/ [7542658] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:30:34 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542658/ [7542659] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:35:00 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542659/ [7542660] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:11:42 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542660/ [7542661] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:22:48 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542661/ [7542662] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:18:35 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542662/ [7542663] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} time: 00:27:18 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542663/ [7542664] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:31:26 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542664/ [7542665] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:18:08 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542665/ [7542666] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} tasks/dashboard} time: 00:55:26 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542666/ [7542667] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:21:11 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542667/ [7542668] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon-stretch} time: 00:16:44 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542668/ [7542669] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} time: 02:57:56 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542669/ [7542670] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:52:02 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542670/ [7542671] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:17:44 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542671/ [7542672] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 01:56:11 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542672/ [7542673] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:24:59 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542673/ [7542674] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:05 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542674/ [7542675] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} time: 00:23:29 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542675/ [7542676] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} time: 00:27:03 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542676/ [7542678] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:10:15 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542678/ [7542680] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:48:23 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542680/ [7542681] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:16:48 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542681/ [7542682] rados/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_3.0} 2-node-mgr orchestrator_cli} time: 00:22:19 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542682/ [7542683] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:34:52 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542683/ [7542684] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:58 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542684/ [7542686] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:44:03 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542686/ [7542687] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:17:24 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542687/ [7542688] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:15:16 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542688/ [7542689] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_18.04} 1-start 2-services/basic 3-final} time: 00:15:56 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542689/ [7542690] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench} time: 00:45:36 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542690/ [7542691] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:30:29 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542691/ [7542692] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:33:20 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542692/ [7542693] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:08:04 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542693/ [7542694] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:09:35 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542694/ [7542696] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:29 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542696/ [7542698] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:22 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542698/ [7542699] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:11:36 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542699/ [7542700] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect} time: 00:24:21 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542700/ [7542701] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:21:15 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542701/ [7542703] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:44:23 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542703/ [7542704] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:15:02 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542704/ [7542706] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:50 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542706/ [7542707] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:22:28 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542707/ [7542708] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.6_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:21:47 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542708/ [7542709] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:33:50 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542709/ [7542710] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:21:12 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542710/ [7542711] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:20:41 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542711/ [7542712] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/per_module_finisher_stats} time: 00:09:42 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542712/ [7542713] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:21:56 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542713/ [7542715] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:13:07 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542715/ [7542716] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:53:37 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542716/ [7542717] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_osdmap_prune} time: 01:07:09 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542717/ [7542718] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:18:46 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542718/ [7542719] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:07:40 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542719/ [7542720] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:31:22 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542720/ [7542721] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:11 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542721/ [7542722] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:40:05 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542722/ [7542723] rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} time: 00:49:28 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542723/ [7542724] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:30:01 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542724/ [7542725] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:31 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542725/ [7542726] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:13:15 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542726/ [7542727] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:19:15 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542727/ [7542728] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:11:05 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542728/ [7542729] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.6_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:17:39 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542729/ [7542730] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:15:59 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542730/ [7542731] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:13 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542731/ [7542732] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects} time: 00:30:20 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542732/ [7542733] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:44:47 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542733/ [7542734] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:12:34 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542734/ [7542735] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:15:43 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542735/ [7542736] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:14:46 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542736/ [7542737] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:23:18 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542737/ [7542739] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:15:14 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542739/ [7542740] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:24:29 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542740/ [7542741] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:50:18 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542741/ [7542742] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:33:16 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542742/ [7542743] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:18:14 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542743/ [7542744] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:12:01 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542744/ [7542745] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:18 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542745/ [7542746] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} time: 00:26:22 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542746/ [7542747] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:21:28 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542747/ [7542748] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:22:04 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542748/ [7542749] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:21:09 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542749/ [7542750] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:08:37 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542750/ [7542751] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} time: 01:02:33 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542751/ [7542753] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/progress} time: 00:28:52 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542753/ [7542754] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:21:46 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542754/ [7542755] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:32:13 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542755/ [7542756] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:15:57 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542756/ [7542757] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} time: 00:56:05 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542757/ [7542758] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:39 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542758/ [7542759] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:37:58 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542759/ [7542761] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:10:46 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542761/ [7542762] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:36:27 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542762/ [7542763] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:30:41 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542763/ [7542764] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:15:05 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542764/ [7542765] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:17:01 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542765/ [7542766] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:10:53 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542766/ [7542767] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:25 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542767/ [7542769] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:39 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542769/ [7542770] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:11:01 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542770/ [7542771] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:22:28 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542771/ [7542772] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:18:58 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542772/ [7542773] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects} time: 00:31:49 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542773/ [7542774] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli_mon} time: 00:27:52 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542774/ [7542775] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:26:31 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542775/ [7542776] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:27:00 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542776/ [7542777] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} time: 00:18:08 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542777/ [7542778] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:35:24 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542778/ [7542779] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:24:54 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542779/ [7542781] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:16:18 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542781/ [7542782] rados/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} time: 00:23:24 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542782/ [7542783] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:44 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542783/ [7542784] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:42 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542784/ [7542786] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:26:53 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542786/ [7542787] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:17:24 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542787/ [7542788] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:30:06 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542788/ [7542789] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:17:15 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542789/ [7542790] rados/singleton/{all/mon-config mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:09:47 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542790/ [7542791] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:10:23 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542791/ [7542792] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:50:23 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542792/ [7542794] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:11:35 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542794/ [7542795] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:13:07 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542795/ [7542796] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/prometheus} time: 00:12:43 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542796/ [7542797] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:32 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542797/ [7542798] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:25:58 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542798/ [7542799] rados/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:34:24 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542799/ [7542801] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:11:18 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542801/ [7542802] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/snaps-few-objects} time: 00:27:43 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542802/ [7542803] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:39 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542803/ [7542804] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:37:14 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542804/ [7542807] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:15:53 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542807/ [7542808] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:24:28 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542808/ [7542809] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:41 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542809/ [7542811] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:26:28 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542811/ [7542812] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.6_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:21:13 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542812/ [7542813] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:55:47 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542813/ [7542816] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:38:25 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542816/ [7542817] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:07:27 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542817/ [7542818] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:23:21 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542818/ [7542819] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:14:37 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542819/ [7542820] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:33:31 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542820/ [7542822] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:14:49 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542822/ [7542823] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:11:24 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542823/ [7542824] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:18 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542824/ [7542826] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:35:24 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542826/ [7542827] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 01:46:31 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542827/ [7542828] rados/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:41:10 info: https://pulpito.ceph.com/yuriw-2024-02-01_21:25:50-rados-wip-yuri2-testing-2024-02-01-0939-pacific-distro-default-smithi/7542828/