2024-02-08T20:51:44.462 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-02-08T20:51:44.462 INFO:teuthology.results:subset: '111/120000' 2024-02-08T20:51:44.462 INFO:teuthology.results:seed: '1730' 2024-02-09T02:21:01.439 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-02-09T02:21:01.471 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-02-09T05:11:18.810 INFO:teuthology.results:Tests finished! gathering results... 2024-02-09T05:11:52.413 INFO:scrape:Found 428 jobs 2024-02-09T05:11:56.346 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552201/teuthology.log 2024-02-09T05:12:05.967 INFO:scrape:Found 10 distinct failure reasons 2024-02-09T05:12:05.967 INFO:scrape:Failure: reached maximum tries (301) after waiting for 300 seconds 2024-02-09T05:12:05.967 INFO:scrape:12 jobs: ['7552525', '7552402', '7552480', '7552148', '7552514', '7552226', '7552187', '7552324', '7552133', '7552171', '7552308', '7552340'] 2024-02-09T05:12:05.968 INFO:scrape:suites intersection: ['0-nvme-loop', '1-start', '3-final}'] 2024-02-09T05:12:05.968 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-services/nfs-ingress', '2-services/nfs-ingress-rgw-bucket', '2-services/nfs-ingress-rgw-user', '2-services/nfs-ingress2', '2-services/rgw-ingress', '3-final}', 'rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0', 'rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8', 'rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04', 'rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04'] 2024-02-09T05:12:05.968 INFO:scrape: 2024-02-09T05:12:05.968 INFO:scrape:Failure: Failed to reconnect to smithi062 2024-02-09T05:12:05.968 INFO:scrape:6 jobs: ['7552219', '7552100', '7552352', '7552505', '7552338', '7552409'] 2024-02-09T05:12:05.968 INFO:scrape:suites intersection: [] 2024-02-09T05:12:05.968 INFO:scrape:suites union: ['0-nvme-loop', '1-install/luminous-v1only', '1-install/mimic', '1-start', '2-services/nfs-ingress-rgw-user', '2-services/nfs-ingress2', '3-final}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'distro/ubuntu_18.04', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'rados', 'rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04', 'rados/cephadm/smoke/{0-nvme-loop', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'start}', 'thrashers/careful', 'thrashers/mapgap', 'thrashosds-health', 'three-plus-one}', 'workloads/radosbench}', 'workloads/test_rbd_api}'] 2024-02-09T05:12:05.969 INFO:scrape: 2024-02-09T05:12:05.969 INFO:scrape:Failure: "2024-02-09T02:27:43.706418+0000 mon.a (mon.0) 491 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log 2024-02-09T05:12:05.969 INFO:scrape:2 jobs: ['7552500', '7552240'] 2024-02-09T05:12:05.969 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_cls_all', 'validater/lockdep}'] 2024-02-09T05:12:05.969 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_cls_all', 'validater/lockdep}'] 2024-02-09T05:12:05.969 INFO:scrape: 2024-02-09T05:12:05.969 INFO:scrape:Failure: Command failed on smithi002 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:5db25abe00e218b6920215c0bef70af7e47c7152 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2d7c956-c6db-11ee-95b6-87774f69a715 -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' 2024-02-09T05:12:05.969 INFO:scrape:1 jobs: ['7552291'] 2024-02-09T05:12:05.969 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-ops/rm-zap-add}', 'rados/cephadm/osds/{0-distro/ubuntu_18.04'] 2024-02-09T05:12:05.969 INFO:scrape: 2024-02-09T05:12:05.970 INFO:scrape:Failure: Command failed on smithi055 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f4e98214-c6ec-11ee-95b6-87774f69a715 -e sha1=5db25abe00e218b6920215c0bef70af7e47c7152 -- bash -c \'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.x | awk \'"\'"\'{print $2}\'"\'"\')\'' 2024-02-09T05:12:05.970 INFO:scrape:1 jobs: ['7552441'] 2024-02-09T05:12:05.970 INFO:scrape:suites: ['2-repo_digest/repo_digest', '3-upgrade/staggered', '4-wait', '5-upgrade-ls', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04'] 2024-02-09T05:12:05.970 INFO:scrape: 2024-02-09T05:12:05.970 INFO:scrape:Failure: Command failed on smithi169 with status 5: 'sudo systemctl stop ceph-55835aee-c6e5-11ee-95b6-87774f69a715@mon.smithi169' 2024-02-09T05:12:05.970 INFO:scrape:18 jobs: ['7552354', '7552197', '7552135', '7552157', '7552379', '7552109', '7552438', '7552468', '7552377', '7552160', '7552222', '7552452', '7552485', '7552330', '7552235', '7552515', '7552414', '7552251'] 2024-02-09T05:12:05.970 INFO:scrape:suites intersection: ['3-upgrade-with-workload'] 2024-02-09T05:12:05.970 INFO:scrape:suites union: ['1-bootstrap/16.2.4', '1-bootstrap/16.2.5', '1-ranks/1', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-nfs', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '4-final}', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn}', 'rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools', 'roles', 'tasks/{0-from/v16.2.4'] 2024-02-09T05:12:05.970 INFO:scrape: 2024-02-09T05:12:05.971 INFO:scrape:Dead: None 2024-02-09T05:12:05.971 INFO:scrape:2 jobs: ['7552201', '7552166'] 2024-02-09T05:12:05.971 INFO:scrape: 2024-02-09T05:12:05.971 INFO:scrape:Failure: timeout expired in wait_until_healthy 2024-02-09T05:12:05.971 INFO:scrape:2 jobs: ['7552223', '7552395'] 2024-02-09T05:12:05.971 INFO:scrape:suites intersection: ['4-wait', '5-upgrade-ls', 'rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9'] 2024-02-09T05:12:05.971 INFO:scrape:suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-upgrade/simple', '3-upgrade/staggered', '4-wait', '5-upgrade-ls', 'mon_election/classic}', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9'] 2024-02-09T05:12:05.971 INFO:scrape: 2024-02-09T05:12:05.971 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi064 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5db25abe00e218b6920215c0bef70af7e47c7152 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2024-02-09T05:12:05.971 INFO:scrape:4 jobs: ['7552510', '7552188', '7552293', '7552405'] 2024-02-09T05:12:05.972 INFO:scrape:suites intersection: ['rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2024-02-09T05:12:05.972 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2024-02-09T05:12:05.972 INFO:scrape: 2024-02-09T05:12:05.972 INFO:scrape:Failure: 'package_manager_version' 2024-02-09T05:12:05.972 INFO:scrape:1 jobs: ['7552385'] 2024-02-09T05:12:05.972 INFO:scrape:suites: ['cluster/{fixed-3', 'openstack}', 'pool/datapool', 'rados/cephadm/rbd_iscsi/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/ceph_iscsi}'] 2024-02-09T05:12:05.972 INFO:scrape: 2024-02-09T05:12:05.988 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/ failed: 47 dead: 2 running: 0 waiting: 0 queued: 0 passed: 379 Fail ================================================================= [7552100] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552100/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552100/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4d272374fb344fd7a9dcd8b4c5f959a8 Failed to reconnect to smithi037 [7552109] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:26:27 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552109/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552109/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7b6fc233a232416d9517a1ff664e20f8 Command failed on smithi183 with status 5: 'sudo systemctl stop ceph-17a86e76-c6c7-11ee-95b6-87774f69a715@mon.smithi183' [7552133] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:42:02 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552133/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552133/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9b28692f0e594584a412cc26c93d1d6b reached maximum tries (301) after waiting for 300 seconds [7552135] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:35:52 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552135/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552135/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6a57893127e04ebd9f02378bb45a4c2a Command failed on smithi102 with status 5: 'sudo systemctl stop ceph-0817fed0-c6cd-11ee-95b6-87774f69a715@mon.smithi102' [7552148] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:44:21 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552148/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552148/ sentry: https://sentry.ceph.com/organizations/ceph/?query=def8f0738dd8451ca108b2d7dbb5788c reached maximum tries (301) after waiting for 300 seconds [7552157] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:26:48 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552157/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552157/ sentry: https://sentry.ceph.com/organizations/ceph/?query=743c3832b75643a19f84a11c05d06974 Command failed on smithi094 with status 5: 'sudo systemctl stop ceph-a6060624-c6cc-11ee-95b6-87774f69a715@mon.smithi094' [7552160] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:23:59 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552160/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552160/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fc5e5a4f134948eebb0dfca9ae2d7662 Command failed on smithi192 with status 5: 'sudo systemctl stop ceph-7bea57dc-c6cc-11ee-95b6-87774f69a715@mon.smithi192' [7552171] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:43:50 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552171/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552171/ sentry: https://sentry.ceph.com/organizations/ceph/?query=581d77153d504bb995f92f756effbeec reached maximum tries (301) after waiting for 300 seconds [7552187] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:41:36 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552187/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552187/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3267308025424ad280c5be1db1c71105 reached maximum tries (301) after waiting for 300 seconds [7552188] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:27:50 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552188/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552188/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dc92a90ec863482386af4a0f88ec476d Command failed (workunit test cephadm/test_cephadm.sh) on smithi164 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5db25abe00e218b6920215c0bef70af7e47c7152 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [7552197] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:32:32 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552197/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552197/ sentry: https://sentry.ceph.com/organizations/ceph/?query=11031ab7974f455fbe43434f0a438449 Command failed on smithi081 with status 5: 'sudo systemctl stop ceph- cecbaeb6-c6d0-11ee-95b6-87774f69a715@mon.smithi081' [7552219] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552219/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552219/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a8091eff277e4b8a99a6ebc48fbcb136 Failed to reconnect to smithi062 [7552222] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:27:25 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552222/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552222/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5588e1a643e24c31bc167e94464e8ba9 Command failed on smithi094 with status 5: 'sudo systemctl stop ceph- cde5a5fa-c6d1-11ee-95b6-87774f69a715@mon.smithi094' [7552223] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} ----------------------------------------------------------------- time: 00:19:57 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552223/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552223/ sentry: https://sentry.ceph.com/organizations/ceph/?query=79bdfb3e464f4de79a48f1b58563be48 timeout expired in wait_until_healthy [7552226] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:45:06 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552226/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552226/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fb5c9d5bf1bf40b0b270a70752536a5c reached maximum tries (301) after waiting for 300 seconds [7552235] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:23:22 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552235/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552235/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aa2ea45921234ceeb031515cf7329736 Command failed on smithi203 with status 5: 'sudo systemctl stop ceph-3ff58890-c6d2-11ee-95b6-87774f69a715@mon.smithi203' [7552240] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:18:45 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552240/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552240/ "2024-02-08T22:50:00.499418+0000 mon.a (mon.0) 472 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log [7552251] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:29:20 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552251/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552251/ sentry: https://sentry.ceph.com/organizations/ceph/?query=84ffb21a02ed4490bb7c31c404fac18d Command failed on smithi155 with status 5: 'sudo systemctl stop ceph- bf9fac54-c6d4-11ee-95b6-87774f69a715@mon.smithi155' [7552291] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:16:07 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552291/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552291/ sentry: https://sentry.ceph.com/organizations/ceph/?query=30c646fd1e9a429ba69a21f2ab484818 Command failed on smithi002 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:5db25abe00e218b6920215c0bef70af7e47c7152 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2d7c956-c6db-11ee-95b6-87774f69a715 -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' [7552293] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:19:26 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552293/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552293/ sentry: https://sentry.ceph.com/organizations/ceph/?query=01cf596a49f0423ab5750271729167cc Command failed (workunit test cephadm/test_cephadm.sh) on smithi001 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5db25abe00e218b6920215c0bef70af7e47c7152 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [7552308] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:43:08 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552308/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552308/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dedbe19e37574d80bfeef1f5522836e6 reached maximum tries (301) after waiting for 300 seconds [7552324] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:40:42 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552324/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552324/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b6fb465234d04dcfaa5a44940ee1852e reached maximum tries (301) after waiting for 300 seconds [7552330] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:26:02 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552330/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552330/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1a2f0643c3404ade9a998ef7131957d7 Command failed on smithi171 with status 5: 'sudo systemctl stop ceph-76dd51a6-c6e3-11ee-95b6-87774f69a715@mon.smithi171' [7552338] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552338/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552338/ sentry: https://sentry.ceph.com/organizations/ceph/?query=00b0a1ea3de24da79ec75fabf83f8b10 Failed to reconnect to smithi152 [7552340] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:38:19 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552340/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552340/ sentry: https://sentry.ceph.com/organizations/ceph/?query=792e1578403142cea0f9343f17885134 reached maximum tries (301) after waiting for 300 seconds [7552352] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552352/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552352/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5cdeec2f2e8f4816b3e376845d9e3cc9 Failed to reconnect to smithi026 [7552354] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:27:24 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552354/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552354/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2a50f143af974c51b303c9e4b8aa0242 Command failed on smithi169 with status 5: 'sudo systemctl stop ceph-55835aee-c6e5-11ee-95b6-87774f69a715@mon.smithi169' [7552377] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:27:02 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552377/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552377/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a38eaa084c18478cac64a39969b92c27 Command failed on smithi088 with status 5: 'sudo systemctl stop ceph-29f117ba-c6e8-11ee-95b6-87774f69a715@mon.smithi088' [7552379] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:22:57 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552379/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552379/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0209892bab944b84aad39d1bcbd9ff02 Command failed on smithi177 with status 5: 'sudo systemctl stop ceph-d4bc4986-c6e7-11ee-95b6-87774f69a715@mon.smithi177' [7552385] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} ----------------------------------------------------------------- time: 00:12:16 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552385/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552385/ sentry: https://sentry.ceph.com/organizations/ceph/?query=405684275413495c8f341747077ea127 'package_manager_version' [7552395] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} ----------------------------------------------------------------- time: 00:19:38 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552395/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552395/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3f665d50bace41ba9efa1d55d21ee174 timeout expired in wait_until_healthy [7552402] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:42:08 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552402/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552402/ sentry: https://sentry.ceph.com/organizations/ceph/?query=82b7c78decf44db0b54fc33c038e2833 reached maximum tries (301) after waiting for 300 seconds [7552405] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:18:17 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552405/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552405/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dbc512124a71487ba4a0591605fe2a69 Command failed (workunit test cephadm/test_cephadm.sh) on smithi105 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5db25abe00e218b6920215c0bef70af7e47c7152 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [7552409] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552409/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552409/ sentry: https://sentry.ceph.com/organizations/ceph/?query=70fb0be1dca24f5186a8ce2fb91779b1 Failed to reconnect to smithi181 [7552414] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:26:18 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552414/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552414/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1913126b46114df590a11f54c817f6da Command failed on smithi106 with status 5: 'sudo systemctl stop ceph-7b50fb86-c6eb-11ee-95b6-87774f69a715@mon.smithi106' [7552438] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:26:15 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552438/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552438/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cd187a7ac6d2461a983f8718407812cd Command failed on smithi179 with status 5: 'sudo systemctl stop ceph-0525933e-c6ed-11ee-95b6-87774f69a715@mon.smithi179' [7552441] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} ----------------------------------------------------------------- time: 00:37:47 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552441/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552441/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2eca950e9b2640b2bce7d60bda8ce203 Command failed on smithi055 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f4e98214-c6ec-11ee-95b6-87774f69a715 -e sha1=5db25abe00e218b6920215c0bef70af7e47c7152 -- bash -c \'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.x | awk \'"\'"\'{print $2}\'"\'"\')\'' [7552452] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:24:12 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552452/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552452/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3d1e34b5c67346189e32790131007217 Command failed on smithi196 with status 5: 'sudo systemctl stop ceph-7231a30a-c6ed-11ee-95b6-87774f69a715@mon.smithi196' [7552468] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:26:13 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552468/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552468/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a8049570cd704d2db7995cff7b5685b9 Command failed on smithi172 with status 5: 'sudo systemctl stop ceph- fe913eae-c6ee-11ee-95b6-87774f69a715@mon.smithi172' [7552480] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:39:18 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552480/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552480/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6f9c01116eac40c4b2e606a7157565b0 reached maximum tries (301) after waiting for 300 seconds [7552485] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:26:22 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552485/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552485/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5399f4f8f7d444d9a38928b265bac504 Command failed on smithi174 with status 5: 'sudo systemctl stop ceph-3c93308a-c6f0-11ee-95b6-87774f69a715@mon.smithi174' [7552500] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:17:42 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552500/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552500/ "2024-02-09T02:27:43.706418+0000 mon.a (mon.0) 491 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log [7552505] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552505/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552505/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a1f696e79db8493abcfc3fcaa8fec04a Failed to reconnect to smithi133 [7552510] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:18:23 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552510/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552510/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1008b7382777469c9c5bcc359ade239c Command failed (workunit test cephadm/test_cephadm.sh) on smithi064 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5db25abe00e218b6920215c0bef70af7e47c7152 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [7552514] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:44:22 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552514/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552514/ sentry: https://sentry.ceph.com/organizations/ceph/?query=078d29a1a5344190b4c3f8599030f2fe reached maximum tries (301) after waiting for 300 seconds [7552515] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:25:36 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552515/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552515/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9615c73fd0374c8695103800f3ce2d5f Command failed on smithi171 with status 5: 'sudo systemctl stop ceph-0e606d7e-c6f3-11ee-95b6-87774f69a715@mon.smithi171' [7552525] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:42:43 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552525/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552525/ sentry: https://sentry.ceph.com/organizations/ceph/?query=01ca4d8d5f054f52b6a811d741f1657a reached maximum tries (301) after waiting for 300 seconds Dead ================================================================= [7552166] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{rhel_8} workloads/ceph_iscsi} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552166/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552166/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7552201] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552201/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552201/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds Pass ================================================================= [7552098] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:45:00 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552098/ [7552099] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:28:56 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552099/ [7552101] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.6_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:18:32 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552101/ [7552102] rados/objectstore/{backends/objectstore supported-random-distro$/{centos_8}} time: 05:18:17 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552102/ [7552103] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:14:59 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552103/ [7552104] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:14:53 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552104/ [7552105] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:15:45 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552105/ [7552106] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:27:31 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552106/ [7552107] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:20:11 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552107/ [7552108] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench} time: 01:07:13 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552108/ [7552110] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:22:29 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552110/ [7552111] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:13 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552111/ [7552112] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:40:49 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552112/ [7552113] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:44:19 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552113/ [7552114] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} time: 00:36:09 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552114/ [7552115] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:35:12 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552115/ [7552116] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:48 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552116/ [7552117] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:11:08 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552117/ [7552118] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:36:44 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552118/ [7552119] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/progress} time: 00:36:21 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552119/ [7552120] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:30:46 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552120/ [7552121] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:27:31 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552121/ [7552122] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:40:30 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552122/ [7552123] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:33:00 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552123/ [7552124] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:21:44 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552124/ [7552125] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:16:44 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552125/ [7552126] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}} time: 01:04:42 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552126/ [7552127] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:16:51 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552127/ [7552128] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:41:00 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552128/ [7552129] rados/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:43:16 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552129/ [7552130] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:26:27 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552130/ [7552131] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:15:39 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552131/ [7552132] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:15:39 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552132/ [7552134] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:11:56 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552134/ [7552136] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:22:17 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552136/ [7552137] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:18:14 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552137/ [7552138] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:39:20 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552138/ [7552139] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:51:31 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552139/ [7552140] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:32:00 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552140/ [7552141] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:22:35 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552141/ [7552142] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:15:20 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552142/ [7552143] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect_set_object} time: 00:38:48 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552143/ [7552144] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_cls_all} time: 00:17:08 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552144/ [7552145] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} time: 00:28:26 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552145/ [7552146] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:24:50 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552146/ [7552147] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:08:52 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552147/ [7552149] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} tasks/dashboard} time: 00:57:38 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552149/ [7552150] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} time: 00:09:02 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552150/ [7552151] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:13:01 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552151/ [7552152] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:26:45 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552152/ [7552153] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:13:10 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552153/ [7552154] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_18.04} time: 02:56:08 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552154/ [7552155] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:31:07 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552155/ [7552156] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} time: 00:25:42 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552156/ [7552158] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:28:43 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552158/ [7552159] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:25:51 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552159/ [7552161] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:26:46 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552161/ [7552162] rados/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr orchestrator_cli} time: 00:21:46 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552162/ [7552163] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:10:39 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552163/ [7552164] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:28 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552164/ [7552165] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:24:47 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552165/ [7552167] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:26:44 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552167/ [7552168] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:21:18 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552168/ [7552169] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:17:29 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552169/ [7552170] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:12:14 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552170/ [7552172] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:15:41 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552172/ [7552173] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:30:58 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552173/ [7552174] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:40:19 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552174/ [7552175] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:39:51 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552175/ [7552176] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:48:45 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552176/ [7552177] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:48:43 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552177/ [7552178] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:36:08 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552178/ [7552179] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:20:59 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552179/ [7552180] rados/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:42:20 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552180/ [7552181] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:15:50 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552181/ [7552182] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:12:29 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552182/ [7552183] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:33:39 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552183/ [7552184] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:33:56 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552184/ [7552185] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:22:02 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552185/ [7552186] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:13:19 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552186/ [7552189] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:51 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552189/ [7552190] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:19:27 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552190/ [7552191] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:10:46 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552191/ [7552192] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.6_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:21:49 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552192/ [7552193] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:39:51 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552193/ [7552194] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:33:06 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552194/ [7552195] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:35:31 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552195/ [7552196] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:12:28 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552196/ [7552198] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} time: 00:32:16 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552198/ [7552199] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} time: 00:22:19 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552199/ [7552200] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:56:32 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552200/ [7552202] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:09:03 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552202/ [7552203] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/workunits} time: 00:12:34 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552203/ [7552204] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:25:19 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552204/ [7552205] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:08:46 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552205/ [7552206] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:50:51 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552206/ [7552207] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:09:41 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552207/ [7552208] rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code} time: 00:43:16 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552208/ [7552209] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:34:03 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552209/ [7552210] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:29:24 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552210/ [7552211] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:34:54 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552211/ [7552212] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.6_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:18:00 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552212/ [7552213] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:16:43 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552213/ [7552214] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:16:35 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552214/ [7552215] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:16:46 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552215/ [7552216] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:02 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552216/ [7552217] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:19:58 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552217/ [7552218] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:24:17 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552218/ [7552220] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:27:47 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552220/ [7552221] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:16:42 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552221/ [7552224] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:12:41 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552224/ [7552225] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:33:37 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552225/ [7552227] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:19:26 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552227/ [7552228] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:27 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552228/ [7552229] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} time: 00:27:10 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552229/ [7552230] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:28:46 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552230/ [7552231] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:22:02 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552231/ [7552232] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:10:39 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552232/ [7552233] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:36:51 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552233/ [7552234] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:23:15 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552234/ [7552236] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:27:33 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552236/ [7552237] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:17:42 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552237/ [7552238] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:33 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552238/ [7552239] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:35:33 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552239/ [7552241] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/one workloads/snaps-few-objects} time: 00:47:20 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552241/ [7552242] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:23:11 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552242/ [7552243] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/crash} time: 00:12:57 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552243/ [7552244] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:44 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552244/ [7552245] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:41:25 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552245/ [7552246] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_striper} time: 00:13:33 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552246/ [7552247] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:33:54 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552247/ [7552248] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:15:35 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552248/ [7552249] rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_8}} time: 00:18:40 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552249/ [7552250] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 01:05:10 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552250/ [7552252] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:10 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552252/ [7552253] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:15:32 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552253/ [7552254] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:11:14 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552254/ [7552255] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:22:32 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552255/ [7552256] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:20:38 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552256/ [7552257] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:12:39 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552257/ [7552258] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:17:52 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552258/ [7552259] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli_mon} time: 00:29:01 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552259/ [7552260] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} time: 00:14:38 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552260/ [7552261] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 01:12:54 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552261/ [7552262] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:26:18 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552262/ [7552263] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:50:05 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552263/ [7552264] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:17:08 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552264/ [7552265] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:12 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552265/ [7552266] rados/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} time: 00:25:05 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552266/ [7552267] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:50:42 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552267/ [7552268] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:29 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552268/ [7552269] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:52 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552269/ [7552270] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:20:50 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552270/ [7552271] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:17:17 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552271/ [7552272] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:18:00 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552272/ [7552273] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:40:12 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552273/ [7552274] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:17:26 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552274/ [7552275] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:13:27 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552275/ [7552276] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:30:40 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552276/ [7552277] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:32:14 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552277/ [7552278] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:14:59 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552278/ [7552279] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:26:35 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552279/ [7552280] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:31:06 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552280/ [7552281] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:12:05 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552281/ [7552282] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:34:36 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552282/ [7552283] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:10:32 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552283/ [7552284] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:17:08 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552284/ [7552285] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/failover} time: 00:14:55 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552285/ [7552286] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:57 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552286/ [7552287] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:16:58 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552287/ [7552288] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:33:55 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552288/ [7552289] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:23:24 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552289/ [7552290] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:20:05 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552290/ [7552292] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:17:54 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552292/ [7552294] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:26 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552294/ [7552295] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:21:57 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552295/ [7552296] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:24:12 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552296/ [7552297] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.6_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:21:07 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552297/ [7552298] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:41:24 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552298/ [7552299] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:19:15 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552299/ [7552300] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 01:31:43 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552300/ [7552301] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:29:40 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552301/ [7552302] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:30:44 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552302/ [7552303] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:07:39 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552303/ [7552304] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:28:05 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552304/ [7552305] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:16:58 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552305/ [7552306] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:34:58 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552306/ [7552307] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 02:51:28 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552307/ [7552309] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:44 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552309/ [7552310] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:21:13 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552310/ [7552311] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} time: 00:31:43 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552311/ [7552312] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:37:12 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552312/ [7552313] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:21:17 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552313/ [7552314] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:32:56 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552314/ [7552315] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:28:34 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552315/ [7552317] rados/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:45:02 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552317/ [7552318] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:27:48 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552318/ [7552319] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.6_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:17:56 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552319/ [7552321] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:10:24 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552321/ [7552322] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:16:05 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552322/ [7552323] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:19:34 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552323/ [7552325] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:09:26 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552325/ [7552326] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:25:06 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552326/ [7552327] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:21:50 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552327/ [7552328] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/insights} time: 00:22:19 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552328/ [7552329] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:36 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552329/ [7552331] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_5925} time: 00:13:05 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552331/ [7552332] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:11:03 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552332/ [7552333] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:47:33 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552333/ [7552334] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:40:04 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552334/ [7552335] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:26:47 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552335/ [7552336] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:20:30 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552336/ [7552337] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:09:53 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552337/ [7552339] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache} time: 00:13:36 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552339/ [7552341] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:51:58 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552341/ [7552343] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:48:15 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552343/ [7552344] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} time: 02:16:43 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552344/ [7552345] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:32:14 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552345/ [7552346] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:12:41 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552346/ [7552347] rados/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:31:27 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552347/ [7552348] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:25:26 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552348/ [7552349] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:18:41 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552349/ [7552350] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:15:54 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552350/ [7552351] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:32:14 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552351/ [7552353] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:28:24 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552353/ [7552355] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:38 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552355/ [7552356] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:13:27 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552356/ [7552357] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:15:25 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552357/ [7552358] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:22:47 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552358/ [7552359] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:35:01 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552359/ [7552360] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:20:18 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552360/ [7552361] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:22:23 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552361/ [7552362] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:08:12 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552362/ [7552363] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} time: 00:27:57 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552363/ [7552364] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:34:08 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552364/ [7552365] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:18:36 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552365/ [7552366] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} tasks/dashboard} time: 00:57:21 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552366/ [7552367] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:19:38 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552367/ [7552368] rados/standalone/{supported-random-distro$/{centos_8} workloads/mon-stretch} time: 00:17:21 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552368/ [7552369] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} time: 02:52:25 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552369/ [7552370] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:50:12 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552370/ [7552371] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:54:17 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552371/ [7552372] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 01:57:13 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552372/ [7552373] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:34:13 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552373/ [7552374] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:46 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552374/ [7552375] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} time: 00:25:01 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552375/ [7552376] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_api_tests} time: 00:28:35 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552376/ [7552378] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:10:29 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552378/ [7552380] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:47:54 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552380/ [7552381] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:16:57 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552381/ [7552382] rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr orchestrator_cli} time: 00:12:15 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552382/ [7552383] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:35:37 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552383/ [7552384] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:40 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552384/ [7552386] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 01:00:28 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552386/ [7552387] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:17:10 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552387/ [7552388] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:15:33 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552388/ [7552389] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:13:09 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552389/ [7552390] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench} time: 00:47:15 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552390/ [7552391] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:31:41 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552391/ [7552392] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:35:34 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552392/ [7552393] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:10:27 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552393/ [7552394] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:10:01 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552394/ [7552396] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:14:09 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552396/ [7552397] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:40:27 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552397/ [7552398] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:59 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552398/ [7552399] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:11:46 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552399/ [7552400] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect} time: 00:14:49 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552400/ [7552401] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:20:43 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552401/ [7552403] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:55:47 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552403/ [7552404] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:14:54 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552404/ [7552406] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:44 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552406/ [7552407] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:23:27 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552407/ [7552408] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.6_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:22:09 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552408/ [7552410] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:21:20 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552410/ [7552411] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:18:37 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552411/ [7552412] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/per_module_finisher_stats} time: 00:09:34 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552412/ [7552413] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:29 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552413/ [7552415] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:13:32 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552415/ [7552416] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:52:32 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552416/ [7552417] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:56:13 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552417/ [7552418] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:19:06 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552418/ [7552419] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:07:39 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552419/ [7552420] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:29:45 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552420/ [7552421] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:53 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552421/ [7552422] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:40:17 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552422/ [7552423] rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} time: 00:46:00 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552423/ [7552424] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:30:19 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552424/ [7552425] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:13:53 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552425/ [7552426] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:23:28 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552426/ [7552427] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:59 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552427/ [7552428] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:10:27 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552428/ [7552429] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.6_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:19:13 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552429/ [7552430] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:16:05 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552430/ [7552431] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:36 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552431/ [7552432] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects} time: 00:20:30 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552432/ [7552433] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:44:18 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552433/ [7552434] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:12:34 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552434/ [7552435] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:15:28 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552435/ [7552436] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:21:26 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552436/ [7552437] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:13:52 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552437/ [7552439] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:22:33 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552439/ [7552440] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:24:30 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552440/ [7552442] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:52 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552442/ [7552443] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:18:15 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552443/ [7552444] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:12:22 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552444/ [7552445] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:10:33 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552445/ [7552446] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} time: 00:26:59 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552446/ [7552447] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:21:39 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552447/ [7552448] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:12:32 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552448/ [7552449] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:29:43 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552449/ [7552450] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:10:40 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552450/ [7552451] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} time: 01:02:11 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552451/ [7552453] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/progress} time: 00:26:42 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552453/ [7552454] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:26 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552454/ [7552455] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:32:26 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552455/ [7552456] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:15:40 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552456/ [7552457] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} time: 00:54:46 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552457/ [7552458] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:33 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552458/ [7552459] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:36:53 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552459/ [7552460] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_workunits} time: 00:38:37 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552460/ [7552461] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:10:47 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552461/ [7552462] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:38:06 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552462/ [7552463] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:23:13 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552463/ [7552464] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:15:02 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552464/ [7552465] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:15:57 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552465/ [7552466] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:11:18 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552466/ [7552467] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:24 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552467/ [7552469] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:35 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552469/ [7552470] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:10:52 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552470/ [7552471] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:23:02 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552471/ [7552472] rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:19:06 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552472/ [7552473] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects} time: 00:21:54 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552473/ [7552474] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli_mon} time: 00:33:51 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552474/ [7552475] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:40:31 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552475/ [7552476] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} time: 03:12:09 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552476/ [7552477] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} time: 00:17:55 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552477/ [7552478] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:35:50 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552478/ [7552479] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:34:48 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552479/ [7552481] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:16:28 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552481/ [7552482] rados/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} time: 00:23:23 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552482/ [7552483] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:13 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552483/ [7552484] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:34:16 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552484/ [7552486] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:28:22 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552486/ [7552487] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:16:57 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552487/ [7552488] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} time: 00:33:02 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552488/ [7552489] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:17:51 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552489/ [7552490] rados/singleton/{all/mon-config mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:09:53 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552490/ [7552491] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:10:50 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552491/ [7552492] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:49:20 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552492/ [7552493] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/classic} time: 00:48:12 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552493/ [7552494] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:11:55 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552494/ [7552495] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:14:40 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552495/ [7552496] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:11:23 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552496/ [7552497] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:22:53 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552497/ [7552498] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:25:12 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552498/ [7552499] rados/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:36:00 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552499/ [7552501] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:11:30 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552501/ [7552502] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/snaps-few-objects} time: 00:28:00 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552502/ [7552503] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:53 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552503/ [7552504] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:56:20 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552504/ [7552506] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:53:12 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552506/ [7552507] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:23:36 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552507/ [7552508] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:34:36 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552508/ [7552509] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:47 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552509/ [7552511] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:26:45 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552511/ [7552512] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.6_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:21:19 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552512/ [7552513] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:50:15 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552513/ [7552516] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:23:54 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552516/ [7552517] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:07:53 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552517/ [7552518] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:27:12 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552518/ [7552519] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:16:13 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552519/ [7552520] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:34:01 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552520/ [7552521] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 02:44:03 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552521/ [7552522] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:23:23 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552522/ [7552523] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:11:29 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552523/ [7552524] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:26 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552524/ [7552526] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:35:26 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552526/ [7552527] rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub} time: 01:50:03 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552527/ [7552528] rados/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:42:36 info: https://pulpito.ceph.com/yuriw-2024-02-08_20:49:13-rados-wip-yuri8-testing-2024-02-07-0820-pacific-distro-default-smithi/7552528/