2022-07-10T03:32:40.339 INFO:root:teuthology version: 1.1.1.dev381+g10062088 2022-07-10T03:32:40.340 INFO:teuthology.results:subset: '24935/99999' 2022-07-10T03:32:40.341 INFO:teuthology.results:seed: '9871' 2022-07-10T06:56:20.500 INFO:root:teuthology version: 1.1.1.dev381+g10062088 2022-07-10T06:56:20.534 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-07-10T11:07:51.942 INFO:teuthology.results:Tests finished! gathering results... 2022-07-10T11:08:25.606 INFO:scrape:Found 413 jobs 2022-07-10T11:08:37.442 INFO:scrape:Found 9 distinct failure reasons 2022-07-10T11:08:37.444 INFO:scrape:Failure: {'smithi072.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi083.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} 2022-07-10T11:08:37.444 INFO:scrape:101 jobs 2022-07-10T11:08:37.445 INFO:scrape:suites intersection: [] 2022-07-10T11:08:37.446 INFO:scrape:suites union: ['0-nvme-loop', '1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '1-start', '2-ops/repave-all}', '2-ops/rm-zap-flag}', '2-ops/rm-zap-wait}', '2-ops/rmdir-reactivate}', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-partial-recovery}', '2-services/basic', '2-services/client-keyring', '2-services/iscsi', '2-services/mirror', '2-services/nfs', '2-services/nfs-ingress', '2-services/nfs-ingress-rgw-bucket', '2-services/nfs-ingress-rgw-user', '2-services/nfs-ingress2', '2-services/nfs2', '2-services/rgw', '2-services/rgw-ingress', '3-final}', '3-scrub-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'cluster/{12-osds', 'clusters/3-mons', 'clusters/9-mons', 'clusters/{fixed-2', 'clusters/{fixed-4', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'debug/mgr', 'distro/rhel_8.4_container_tools_3.0', 'distro/rhel_8.4_container_tools_rhel8', 'fast/fast', 'fast/normal', 'fixed-2', 'mgr_ttl_cache/disable', 'mgr_ttl_cache/enable', 'mode/packaged', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/mon-delay', 'msgr-failures/none', 'msgr-failures/osd-delay', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'no_pools', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0', 'rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8', 'rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0', 'rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8', 'rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_3.0}', 'rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8}', 'rados/cephadm/smoke/{0-nvme-loop', 'rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0', 'rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/monthrash/{ceph', 'rados/multimon/{clusters/21', 'rados/multimon/{clusters/9', 'rados/objectstore/{backends/alloc-hint', 'rados/objectstore/{backends/filestore-idempotent', 'rados/objectstore/{backends/keyvaluedb', 'rados/rest/{mgr-restful', 'rados/singleton-bluestore/{all/cephtool', 'rados/singleton-nomsgr/{all/balancer', 'rados/singleton-nomsgr/{all/ceph-kvstore-tool', 'rados/singleton-nomsgr/{all/ceph-post-file', 'rados/singleton-nomsgr/{all/export-after-evict', 'rados/singleton-nomsgr/{all/full-tiering', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'rados/singleton-nomsgr/{all/librados_hello_world', 'rados/singleton-nomsgr/{all/msgr', 'rados/singleton-nomsgr/{all/pool-access', 'rados/singleton-nomsgr/{all/recovery-unfound-found', 'rados/singleton-nomsgr/{all/version-number-sanity', 'rados/singleton/{all/admin-socket', 'rados/singleton/{all/ec-inconsistent-hinfo', 'rados/singleton/{all/ec-lost-unfound', 'rados/singleton/{all/erasure-code-nonregression', 'rados/singleton/{all/mon-auth-caps', 'rados/singleton/{all/mon-config-key-caps', 'rados/singleton/{all/pg-autoscaler', 'rados/singleton/{all/pg-autoscaler-progress-off', 'rados/singleton/{all/random-eio', 'rados/singleton/{all/recovery-preemption', 'rados/singleton/{all/resolve_stuck_peering', 'rados/singleton/{all/test_envlibrados_for_rocksdb', 'rados/singleton/{all/thrash-eio', 'rados/singleton/{all/watch-notify-same-primary', 'rados/standalone/{supported-random-distro$/{rhel_8}', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'rados/thrash-erasure-code-shec/{ceph', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'recovery-overrides/{default}', 'recovery-overrides/{more-active-recovery}', 'recovery-overrides/{more-async-partial-recovery}', 'recovery-overrides/{more-async-recovery}', 'recovery-overrides/{more-partial-recovery}', 'start', 'start}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'tasks/crash}', 'tasks/failover}', 'tasks/insights}', 'tasks/libcephsqlite}', 'tasks/mon_clock_with_skews}', 'tasks/progress}', 'tasks/rados_api_tests}', 'tasks/rados_cls_all}', 'tasks/rados_python}', 'tasks/rados_striper}', 'tasks/workunits}', 'thrashers/careful', 'thrashers/default', 'thrashers/fastread', 'thrashers/mapgap', 'thrashers/minsize_recovery', 'thrashers/morepggrow', 'thrashers/one', 'thrashers/pggrow', 'thrashers/sync', 'thrashers/sync-many', 'thrashosds-health', 'workloads/cache-agent-small}', 'workloads/cache-pool-snaps-readproxy}', 'workloads/cache-pool-snaps}', 'workloads/cache-snaps}', 'workloads/cache}', 'workloads/crush}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=3-m=1}', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}', 'workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'workloads/ec-radosbench}', 'workloads/ec-small-objects-balanced}', 'workloads/ec-small-objects-overwrites}', 'workloads/ec-small-objects}', 'workloads/ec-snaps-few-objects-overwrites}', 'workloads/erasure-code}', 'workloads/mgr}', 'workloads/osd}', 'workloads/pool-snaps-few-objects}', 'workloads/rados_5925}', 'workloads/rados_api_tests}', 'workloads/rados_mon_workunits}', 'workloads/snaps-few-objects}'] 2022-07-10T11:08:37.447 INFO:scrape: 2022-07-10T11:08:37.447 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi139.front.sepia.ceph.com: ['type=AVC msg=audit(1657425577.381:18191): avc: denied { ioctl } for pid=119624 comm="iptables" path="/var/lib/containers/storage/overlay/249156ab2f389c6ac9c2ca25dedc27bc9e837daca02a7919bfed1584584d45dd/merged" dev="overlay" ino=3805285 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] 2022-07-10T11:08:37.448 INFO:scrape:3 jobs: ['6921687', '6921892', '6921795'] 2022-07-10T11:08:37.448 INFO:scrape:suites intersection: ['rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2022-07-10T11:08:37.449 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2022-07-10T11:08:37.449 INFO:scrape: 2022-07-10T11:08:37.449 INFO:scrape:Failure: Command failed on smithi099 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2072c37c-0016-11ed-842e-001a4aab830c -e sha1=d56c5c84f520641c4e8344273f00f783f914b733 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2022-07-10T11:08:37.450 INFO:scrape:6 jobs: ['6921897', '6922033', '6921902', '6921972', '6921761', '6921698'] 2022-07-10T11:08:37.450 INFO:scrape:suites intersection: ['3-upgrade-with-workload'] 2022-07-10T11:08:37.451 INFO:scrape:suites union: ['1-bootstrap/16.2.4', '1-bootstrap/octopus', '1-ranks/1', '1-start', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '2-nfs', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '4-final}', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools', 'roles', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-07-10T11:08:37.451 INFO:scrape: 2022-07-10T11:08:37.452 INFO:scrape:Failure: Command failed on smithi052 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:d56c5c84f520641c4e8344273f00f783f914b733 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e79882ca-001b-11ed-842e-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' 2022-07-10T11:08:37.452 INFO:scrape:1 jobs: ['6921997'] 2022-07-10T11:08:37.453 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-ops/rm-zap-add}', 'rados/cephadm/osds/{0-distro/ubuntu_18.04'] 2022-07-10T11:08:37.453 INFO:scrape: 2022-07-10T11:08:37.453 INFO:scrape:Failure: [Errno 2] Cannot find file on the remote 'ubuntu@smithi057.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' 2022-07-10T11:08:37.454 INFO:scrape:2 jobs: ['6922039', '6921782'] 2022-07-10T11:08:37.454 INFO:scrape:suites intersection: ['0-kubeadm', '1-rook', '2-workload/radosbench', '3-final', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_18.04', 'rook/master}'] 2022-07-10T11:08:37.455 INFO:scrape:suites union: ['0-kubeadm', '1-rook', '2-workload/radosbench', '3-final', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_18.04', 'rook/master}'] 2022-07-10T11:08:37.455 INFO:scrape: 2022-07-10T11:08:37.456 INFO:scrape:Failure: 'wait for operator' reached maximum tries (90) after waiting for 900 seconds 2022-07-10T11:08:37.456 INFO:scrape:2 jobs: ['6921652', '6921911'] 2022-07-10T11:08:37.457 INFO:scrape:suites intersection: ['0-kubeadm', '1-rook', '2-workload/none', '3-final', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.6.2}'] 2022-07-10T11:08:37.457 INFO:scrape:suites union: ['0-kubeadm', '1-rook', '2-workload/none', '3-final', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.6.2}'] 2022-07-10T11:08:37.457 INFO:scrape: 2022-07-10T11:08:37.458 INFO:scrape:Failure: Command failed on smithi037 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2022-07-10T11:08:37.458 INFO:scrape:1 jobs: ['6921753'] 2022-07-10T11:08:37.459 INFO:scrape:suites: ['clusters/{2-node-mgr}', 'debug/mgr', 'mon_election/connectivity', 'rados/dashboard/{centos_8.stream_container_tools', 'random-objectstore$/{bluestore-comp-lz4}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/dashboard}'] 2022-07-10T11:08:37.459 INFO:scrape: 2022-07-10T11:08:37.460 INFO:scrape:Failure: {'smithi130.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi070.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} 2022-07-10T11:08:37.460 INFO:scrape:4 jobs: ['6921696', '6921887', '6922032', '6922017'] 2022-07-10T11:08:37.461 INFO:scrape:suites intersection: [] 2022-07-10T11:08:37.461 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-ops/rm-zap-wait}', '2-services/nfs-ingress-rgw-user', '3-final}', 'ceph', 'clusters/{fixed-2', 'distro/rhel_8.4_container_tools_rhel8', 'fixed-2', 'mon_election/classic', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0', 'rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8', 'rados/cephadm/smoke/{0-nvme-loop', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'recovery-overrides/{more-partial-recovery}', 'start}', 'supported-random-distro$/{rhel_8}', 'thrashers/none', 'thrashosds-health', 'workloads/ec-rados-plugin=isa-k=2-m=1}'] 2022-07-10T11:08:37.461 INFO:scrape: 2022-07-10T11:08:37.462 INFO:scrape:Failure: "2022-07-10T07:06:57.489318+0000 osd.0 (osd.0) 73 : cluster [ERR] 4.3 scrub : stat mismatch, got 48/48 objects, 5/5 clones, 25/25 dirty, 0/0 omap, 0/0 pinned, 1/1 hit_set_archive, 12/12 whiteouts, 101437251/102897074 bytes, 0/0 manifest objects, 241/241 hit_set_archive bytes." in cluster log 2022-07-10T11:08:37.462 INFO:scrape:1 jobs: ['6922008'] 2022-07-10T11:08:37.463 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/fastclose', 'msgr/async-v1only', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{centos_8}', 'thrashers/pggrow', 'thrashosds-health', 'workloads/cache-snaps-balanced}'] 2022-07-10T11:08:37.463 INFO:scrape: 2022-07-10T11:08:37.477 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/ failed: 16 dead: 105 running: 0 waiting: 0 queued: 0 passed: 292 Fail ================================================================= [6921652] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/calico rook/1.6.2} ----------------------------------------------------------------- time: 00:27:18 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921652/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921652/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6442a99587c54363a60a80d9c5d65590 'wait for operator' reached maximum tries (90) after waiting for 900 seconds [6921687] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:21:31 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921687/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921687/ SELinux denials found on ubuntu@smithi139.front.sepia.ceph.com: ['type=AVC msg=audit(1657425577.381:18191): avc: denied { ioctl } for pid=119624 comm="iptables" path="/var/lib/containers/storage/overlay/249156ab2f389c6ac 9c2ca25dedc27bc9e837daca02a7919bfed1584584d45dd/merged" dev="overlay" ino=3805285 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [6921698] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:23:36 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921698/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921698/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a0ba414490f1434880bad22a79ed1748 Command failed on smithi031 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3682ef4-0005-11ed-842e-001a4aab830c -e sha1=d56c5c84f520641c4e8344273f00f783f914b733 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6921753] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 00:05:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921753/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921753/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9989828cea464074aae9fb99c531ab20 Command failed on smithi037 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6921761] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:23:31 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921761/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921761/ sentry: https://sentry.ceph.com/organizations/ceph/?query=83dea7a129754c4197fc78105957ccbe Command failed on smithi137 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fac61392-0009-11ed-842e-001a4aab830c -e sha1=d56c5c84f520641c4e8344273f00f783f914b733 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6921782] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:08:16 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921782/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921782/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e43bd2279b45435eb5235a33ddb79880 [Errno 2] Cannot find file on the remote 'ubuntu@smithi026.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' [6921795] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:19:04 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921795/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921795/ SELinux denials found on ubuntu@smithi006.front.sepia.ceph.com: ['type=AVC msg=audit(1657429189.613:18192): avc: denied { ioctl } for pid=119766 comm="iptables" path="/var/lib/containers/storage/overlay/0a5b7afd8cbffb248 8909e871964537ab6e6b1f54e6cbf82870c5abe5eccbbaf/merged" dev="overlay" ino=3805289 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [6921892] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:18:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921892/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921892/ SELinux denials found on ubuntu@smithi105.front.sepia.ceph.com: ['type=AVC msg=audit(1657433292.358:18197): avc: denied { ioctl } for pid=119770 comm="iptables" path="/var/lib/containers/storage/overlay/e8f82321d494c5a2e 043abbb8e38aebdc5c140278dd77ac99058ac5a18016cdd/merged" dev="overlay" ino=3805317 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1657433292.410:18198): avc: denied { ioctl } for pid=119786 comm="iptables" path="/var/lib/containers/storage/o verlay/e8f82321d494c5a2e043abbb8e38aebdc5c140278dd77ac99058ac5a18016cdd/mer ged" dev="overlay" ino=3805317 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [6921897] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:27:10 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921897/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921897/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a2d73fbeeb744d9ea6d43218b89490e8 Command failed on smithi099 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2072c37c-0016-11ed-842e-001a4aab830c -e sha1=d56c5c84f520641c4e8344273f00f783f914b733 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6921902] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:26:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921902/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921902/ sentry: https://sentry.ceph.com/organizations/ceph/?query=11b0a8a52d2b4e6a8e79f742358db060 Command failed on smithi008 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f898e32c-0015-11ed-842e-001a4aab830c -e sha1=d56c5c84f520641c4e8344273f00f783f914b733 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6921911] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2} ----------------------------------------------------------------- time: 00:31:37 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921911/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921911/ sentry: https://sentry.ceph.com/organizations/ceph/?query=09ab376c6c7c47259124b95a868f22b2 'check osd count' reached maximum tries (90) after waiting for 900 seconds [6921972] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:24:38 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921972/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921972/ sentry: https://sentry.ceph.com/organizations/ceph/?query=201f1142e75642378ce7faa4349ad12e Command failed on smithi067 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b7783672-001a-11ed-842e-001a4aab830c -e sha1=d56c5c84f520641c4e8344273f00f783f914b733 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6921997] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:17:49 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921997/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921997/ sentry: https://sentry.ceph.com/organizations/ceph/?query=49ff723dbff545949baf60a53f82cbb2 Command failed on smithi052 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:d56c5c84f520641c4e8344273f00f783f914b733 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e79882ca-001b-11ed-842e-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' [6922008] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} ----------------------------------------------------------------- time: 00:24:43 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922008/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922008/ "2022-07-10T07:06:57.489318+0000 osd.0 (osd.0) 73 : cluster [ERR] 4.3 scrub : stat mismatch, got 48/48 objects, 5/5 clones, 25/25 dirty, 0/0 omap, 0/0 pinned, 1/1 hit_set_archive, 12/12 whiteouts, 101437251/102897074 bytes, 0/0 manifest objects, 241/241 hit_set_archive bytes." in cluster log [6922033] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:24:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922033/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922033/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9c42e7f250f648678031d3aaa744d88b Command failed on smithi175 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 526be2ba-001f-11ed-842e-001a4aab830c -e sha1=d56c5c84f520641c4e8344273f00f783f914b733 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6922039] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:08:07 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922039/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922039/ sentry: https://sentry.ceph.com/organizations/ceph/?query=29759f4c5f1545df9584b56c2f7d6db7 [Errno 2] Cannot find file on the remote 'ubuntu@smithi057.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' Dead ================================================================= [6921633] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_striper} ----------------------------------------------------------------- time: 00:11:48 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921633/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921633/ sentry: https://sentry.ceph.com/organizations/ceph/?query=96f13409b2374af68a51070b7c1bf190 {'smithi161.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi156.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921635] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-small} ----------------------------------------------------------------- time: 00:07:12 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921635/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921635/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f2d25b9ab2d2499aa39b2c5b64f769ae {'smithi031.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi170.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921655] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:00 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921655/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921655/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9f41de3e01654db28b15d815456db95d {'smithi132.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921661] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} ----------------------------------------------------------------- time: 00:14:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921661/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921661/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6bb549800b384779944e0de4d5509ed6 {'smithi059.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi066.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi042.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921664] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} ----------------------------------------------------------------- time: 00:11:20 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921664/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921664/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7c0a409d5aac4bb2b566c180c5f49e3d {'smithi155.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi169.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921667] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} ----------------------------------------------------------------- time: 00:09:26 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921667/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921667/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3a1a10b5fc0b4cfb8c40f3d6ced8fa2c {'smithi081.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921671] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:07:05 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921671/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921671/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dc7cfa5f0f6e482ebd739b2696bccced {'smithi018.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921679] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:11:18 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921679/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921679/ sentry: https://sentry.ceph.com/organizations/ceph/?query=51937b308b324ad5b4d4c862a39840ea {'smithi006.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi171.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921680] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:26 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921680/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921680/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6d00f0e133dd439b955ffc60f520f7e1 {'smithi036.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921682] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:11:41 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921682/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921682/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f852f0c0edf34d00ade354fa6b8b270a {'smithi179.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi038.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921688] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:10:55 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921688/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921688/ sentry: https://sentry.ceph.com/organizations/ceph/?query=010ecaaa9dcf48619fcdc041592bc572 {'smithi125.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi001.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921689] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} ----------------------------------------------------------------- time: 00:11:39 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921689/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921689/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7debd957009b4c9fbbb5b33c579a88e2 {'smithi122.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi064.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921692] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/failover} ----------------------------------------------------------------- time: 00:11:13 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921692/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921692/ sentry: https://sentry.ceph.com/organizations/ceph/?query=09a53823978d4724a4b92f1829b30d5c {'smithi117.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi154.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921694] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:10:14 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921694/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921694/ sentry: https://sentry.ceph.com/organizations/ceph/?query=180ae61cea204fbba2cbc150fb876948 {'smithi102.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi190.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921696] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:11:36 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921696/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921696/ sentry: https://sentry.ceph.com/organizations/ceph/?query=14d8fa351b1f4aa79cec0daa3421755e {'smithi130.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi070.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921702] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:06:22 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921702/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921702/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b40b14140b0d43968d531b660f56790a {'smithi169.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi154.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi155.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921704] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:06:12 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921704/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921704/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2b1ce4266abb45a3bd31a8098030f35f {'smithi171.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi189.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921709] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:06:10 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921709/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921709/ sentry: https://sentry.ceph.com/organizations/ceph/?query=41e459f8f959463687e8a8481f053383 {'smithi070.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi130.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921714] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:52 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921714/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921714/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3b0016d5efbc4e99b3beedc53190d254 {'smithi022.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921716] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:17 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921716/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921716/ sentry: https://sentry.ceph.com/organizations/ceph/?query=67219fa6ddee455791324e1ad967afdf {'smithi192.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921718] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} ----------------------------------------------------------------- time: 00:05:22 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921718/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921718/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4ecd871628bc44479cdedf39573f2e3d {'smithi097.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi047.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921719] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:05:21 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921719/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921719/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ed574b95be0e4bc4982d08d5de03b3ce {'smithi163.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi202.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921722] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} ----------------------------------------------------------------- time: 00:05:42 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921722/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921722/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2adb9fa6bf8b432c94e9489e435d2d4a {'smithi174.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi094.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921723] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921723/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921723/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a852c768a32042539f84ff5465c44b30 {'smithi075.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921727] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:57 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921727/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921727/ sentry: https://sentry.ceph.com/organizations/ceph/?query=59bfe5e4a3504de798bbf7906ab871ea {'smithi040.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921729] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:00 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921729/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921729/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d6fe270a4c4543a9a37e4f8654ce05f2 {'smithi171.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921736] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:06:32 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921736/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921736/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8f1b4cd6f8104c82b1167eb4db2178be {'smithi067.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi055.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921738] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:06:19 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921738/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921738/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a4b79e24db564667804472bae40f6682 {'smithi143.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi089.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921742] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:48 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921742/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921742/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2767137846b145e695e92dcf24eae680 {'smithi192.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921747] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} ----------------------------------------------------------------- time: 00:05:54 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921747/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921747/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c7110fa951ec4f14a8915a41d1ff61f6 {'smithi203.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi005.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921756] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:06:24 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921756/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921756/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ee15f8a2c50a477cb51b384486934cd1 {'smithi075.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi174.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921765] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:27 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921765/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921765/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f7403affd6e24bcea7e8cd16cdc36cde {'smithi031.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921767] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 00:06:38 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921767/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921767/ sentry: https://sentry.ceph.com/organizations/ceph/?query=771f147c35d24620bc19e6dfa8023477 {'smithi059.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi042.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921770] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:06:42 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921770/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921770/ sentry: https://sentry.ceph.com/organizations/ceph/?query=379984fdfab94f53880a7900b5eefbf5 {'smithi195.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi074.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi143.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi164.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921771] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:06:05 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921771/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921771/ sentry: https://sentry.ceph.com/organizations/ceph/?query=caf60f40839c45f79f30867646bb0ed4 {'smithi172.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921791] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:06:29 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921791/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921791/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fff57b38103e420c88f1999e0030e976 {'smithi202.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi022.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921801] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:36 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921801/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921801/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ab8d77d1af174535bf68d04b4a2a4afb {'smithi164.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi143.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921809] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:42 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921809/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921809/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4f6727b3331f4e2286d81508a7d3f89b {'smithi185.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921811] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:05:48 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921811/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921811/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7684cc9b52844e4dbf0557b130f4355d {'smithi161.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi156.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921812] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} ----------------------------------------------------------------- time: 00:05:56 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921812/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921812/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0a8214e4117b4652a88bcbffe9e4fb85 {'smithi204.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi162.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921813] rados/multimon/{clusters/21 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} ----------------------------------------------------------------- time: 00:06:13 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921813/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921813/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9230cabcff7c43e2bba3db8d4b9569dc {'smithi159.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi186.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi157.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921814] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:52 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921814/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921814/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e3d1d9d0253e47bea3d8fa7f35e6d61c {'smithi026.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921815] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/progress} ----------------------------------------------------------------- time: 00:06:02 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921815/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921815/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aaf9ba272e004ba797b6c2df1254ba88 {'smithi202.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi022.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921817] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} ----------------------------------------------------------------- time: 00:06:04 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921817/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921817/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d8393b6ee70a45af8fdd06e16b185e8c {'smithi179.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi089.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921823] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:29 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921823/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921823/ sentry: https://sentry.ceph.com/organizations/ceph/?query=65d839e1b1b74ebb967891757f176210 {'smithi203.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921835] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} ----------------------------------------------------------------- time: 00:05:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921835/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921835/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a5c20c23292b4b6297bb740f411b5f67 {'smithi135.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi008.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921841] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd} ----------------------------------------------------------------- time: 00:06:28 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921841/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921841/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4da9bbf2401848cfa36fd5366b6885bf {'smithi185.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921843] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:42 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921843/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921843/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9a74db01cfcc416f880d24fd916a4922 {'smithi170.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi164.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921856] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} ----------------------------------------------------------------- time: 00:06:43 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921856/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921856/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a69ae90fce7f44f385fc2e14ec7986ea {'smithi053.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi152.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921863] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:29 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921863/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921863/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4e6bbb3cde96493c9ec3c6a228b22120 {'smithi201.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921864] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:31 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921864/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921864/ sentry: https://sentry.ceph.com/organizations/ceph/?query=798ccfad224e4576ae0e4f3da32eafb2 {'smithi134.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921868] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:08:24 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921868/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921868/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a3f9810f27554d579fc589b36eb0d686 {'smithi099.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi124.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi052.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921872] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:06:56 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921872/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921872/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dcf5e043ae32418a94983307c8fb7ea2 {'smithi098.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921874] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:07:42 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921874/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921874/ sentry: https://sentry.ceph.com/organizations/ceph/?query=58cce99dd6634b9b82d2f49e078780a9 {'smithi153.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi045.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921876] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:07:01 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921876/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921876/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6ad3b614f4604ba5ad2de8348c1861d2 {'smithi066.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921880] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:07:38 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921880/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921880/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e1033076add84b7da50af72f128280c0 {'smithi172.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi043.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921886] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:06:04 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921886/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921886/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4dd941ebe86647a0898e6d6797c934e1 {'smithi152.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi053.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921887] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:06:00 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921887/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921887/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5d1ecb49bc0e42da9692d15b12574b3d {'smithi195.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi075.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921888] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_5925} ----------------------------------------------------------------- time: 00:06:01 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921888/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921888/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f22587577dd9459390acecdd0e48f299 {'smithi074.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi164.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921889] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:06:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921889/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921889/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d5b4cebba5bc4edbb24e1bca89967ff4 {'smithi167.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi154.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921894] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} ----------------------------------------------------------------- time: 00:06:39 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921894/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921894/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7db588d889f247468a398fe8a8106fd0 {'smithi203.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi175.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921896] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/workunits} ----------------------------------------------------------------- time: 00:06:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921896/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921896/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e3532270d1c4452c9e6198ae2af42715 {'smithi098.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi081.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921898] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} ----------------------------------------------------------------- time: 00:06:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921898/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921898/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2336b75d862e433487644728500244a0 {'smithi052.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi018.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921900] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:06:55 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921900/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921900/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4bf959159c4e4c8c8895fb05cf948f97 {'smithi158.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi035.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921905] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:38 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921905/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921905/ sentry: https://sentry.ceph.com/organizations/ceph/?query=afdce328ce8943fba3b23d0f6935379c {'smithi100.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921908] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:07:09 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921908/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921908/ sentry: https://sentry.ceph.com/organizations/ceph/?query=17d4c86ed0714ea9bba69ba3d9331eb7 {'smithi159.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi169.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921910] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:07:13 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921910/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921910/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d7992605a5d543b095eff3c7590e4cef {'smithi107.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi017.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921914] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:07:26 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921914/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921914/ sentry: https://sentry.ceph.com/organizations/ceph/?query=79278fd8dd1c45ef9e17136c68bf2807 {'smithi064.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi059.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921919] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} ----------------------------------------------------------------- time: 00:07:17 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921919/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921919/ sentry: https://sentry.ceph.com/organizations/ceph/?query=638eea232ebd4d03ab3576b426498795 {'smithi161.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi162.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921920] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} ----------------------------------------------------------------- time: 00:07:07 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921920/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921920/ sentry: https://sentry.ceph.com/organizations/ceph/?query=592bc44d86964211a457e23b7ed5fc0e {'smithi139.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi119.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921923] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921923/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921923/ sentry: https://sentry.ceph.com/organizations/ceph/?query=318def1ae1be4d6996c95c3da397f4bf {'smithi063.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921925] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:07:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921925/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921925/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3f7a802e5da6458e9c7354314a8e9c1c {'smithi075.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi195.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921928] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:06:56 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921928/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921928/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b61f27ca28b0460f893d9124fd1eae48 {'smithi145.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi081.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921932] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921932/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921932/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fa49a92318894f1a8bc5ac751f0770b2 {'smithi100.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921936] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/crash} ----------------------------------------------------------------- time: 00:07:07 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921936/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921936/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ae910084f6df40f18b04fd6c5a64831f {'smithi102.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi190.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921937] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} ----------------------------------------------------------------- time: 00:07:45 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921937/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921937/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b98d67bf481a4aa8acd20e983ca468b8 {'smithi157.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi006.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi005.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921939] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} ----------------------------------------------------------------- time: 00:07:12 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921939/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921939/ sentry: https://sentry.ceph.com/organizations/ceph/?query=29b305bbcd16417ebec48d9d26431a6e {'smithi072.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi083.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921947] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:07:24 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921947/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921947/ sentry: https://sentry.ceph.com/organizations/ceph/?query=77e0a7f94a434881a6c951c2027f6fcf {'smithi033.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi057.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921949] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:53 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921949/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921949/ sentry: https://sentry.ceph.com/organizations/ceph/?query=76b703fcb7244931bbfbf750da8c328a {'smithi063.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921954] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} ----------------------------------------------------------------- time: 00:07:16 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921954/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921954/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ad4b24b00ef04f90a653322a8fc0bff9 {'smithi121.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi143.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921956] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:07:12 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921956/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921956/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9fdc8688a54449319ab1b06d18006248 {'smithi145.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi081.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921957] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921957/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921957/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ce17419f0f734d33b5e209b31d701d03 {'smithi105.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921958] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} ----------------------------------------------------------------- time: 00:07:04 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921958/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921958/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0a7c1cf9a096496a83f14c4883aa08ed {'smithi185.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi148.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921960] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921960/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921960/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e798a1e99a984d1da1f71093c86c23c4 {'smithi100.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921961] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921961/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921961/ sentry: https://sentry.ceph.com/organizations/ceph/?query=01a344bd96464738b2d2b60d19ea0bad {'smithi036.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921963] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} ----------------------------------------------------------------- time: 00:06:40 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921963/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921963/ sentry: https://sentry.ceph.com/organizations/ceph/?query=949bc824d34f4d03abc0856aec744942 {'smithi032.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921971] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921971/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921971/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c87efa4d183a4c73bbda6789411240ef {'smithi123.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921981] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-radosbench} ----------------------------------------------------------------- time: 00:07:44 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921981/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921981/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9d2aab90efb648379060d7c190b8e90f {'smithi081.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi145.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921983] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:07:05 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921983/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921983/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5b2efec22d9749dab38f233c28a57043 {'smithi150.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921984] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} ----------------------------------------------------------------- time: 00:07:50 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921984/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921984/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fe9f70c1c5dd4b11a23364ba5b70b014 {'smithi158.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi174.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6921999] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:50 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921999/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921999/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ce1af3ea71674b6f9101041ccec586d8 {'smithi107.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922000] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:07:00 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922000/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922000/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8c89fcfd2ca344d3b01e1d05a6e604f8 {'smithi154.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi167.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922007] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:11 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922007/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922007/ sentry: https://sentry.ceph.com/organizations/ceph/?query=810d3955ebc64f2f8f5ba186b608c3fd {'smithi155.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922013] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:06:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922013/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922013/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ec2101af1c244d46a5f64065a1038819 {'smithi141.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi136.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi129.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi097.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922017] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:06:29 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922017/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922017/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4407274d491746e29380f68b4b978996 {'smithi153.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi107.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922018] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} ----------------------------------------------------------------- time: 00:06:09 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922018/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922018/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a24af6ac298646c09bf77017b6f9ba54 {'smithi087.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922019] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/insights} ----------------------------------------------------------------- time: 00:06:18 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922019/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922019/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d02b7a1582cc489687017ad96b6f238a {'smithi167.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi154.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922027] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:06:24 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922027/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922027/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a05043e00c6b41779e9c7ed4cfc762ba {'smithi172.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi109.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922030] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:07:14 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922030/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922030/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0de5e036cda7468b8c59303a87952ad5 {'smithi031.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi066.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922032] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:06:55 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922032/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922032/ sentry: https://sentry.ceph.com/organizations/ceph/?query=697dbb5797534ea9bfec27f69a1e1ab9 {'smithi086.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi077.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922034] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:41 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922034/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922034/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d22635e521024c9c97de27d0c432e084 {'smithi036.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922036] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:46 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922036/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922036/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c3bab95bf6d44c4d8392f5a96f10e4d3 {'smithi155.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922040] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache} ----------------------------------------------------------------- time: 00:07:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922040/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922040/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ca2e8ca7c8a343c0b599bf3de0711591 {'smithi204.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi202.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922041] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:07:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922041/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922041/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a4209a5d48264f5d9bbe8d4a995d8fff {'smithi131.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi171.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922042] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:55 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922042/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922042/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7dceca9228c547a8a073598a4beaf490 {'smithi040.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} Pass ================================================================= [6921634] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:57:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921634/ [6921636] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:38:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921636/ [6921637] rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} time: 00:13:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921637/ [6921638] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:42:38 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921638/ [6921639] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:25:36 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921639/ [6921640] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 01:17:44 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921640/ [6921641] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:37:18 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921641/ [6921642] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:14:20 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921642/ [6921643] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_5925} time: 00:19:29 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921643/ [6921644] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:26:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921644/ [6921645] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:32:09 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921645/ [6921646] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 02:38:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921646/ [6921647] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:19:45 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921647/ [6921648] rados/multimon/{clusters/21 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:13:53 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921648/ [6921649] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:39:32 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921649/ [6921650] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:28:32 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921650/ [6921651] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/crash} time: 00:22:26 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921651/ [6921653] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:24:59 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921653/ [6921654] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:26:12 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921654/ [6921656] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:19:45 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921656/ [6921657] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:14:05 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921657/ [6921658] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:32:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921658/ [6921659] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:36:44 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921659/ [6921660] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/lockdep} time: 00:27:12 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921660/ [6921662] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:36:57 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921662/ [6921663] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:23:05 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921663/ [6921665] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:50:15 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921665/ [6921666] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:18:41 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921666/ [6921668] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 00:39:23 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921668/ [6921669] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:30:33 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921669/ [6921670] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:17:10 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921670/ [6921672] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:22:21 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921672/ [6921673] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:39:18 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921673/ [6921674] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 01:37:39 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921674/ [6921675] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:43:24 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921675/ [6921676] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/classic} time: 00:57:40 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921676/ [6921677] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-snaps-balanced} time: 00:23:38 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921677/ [6921678] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_fio} time: 00:17:43 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921678/ [6921681] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 01:09:15 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921681/ [6921683] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:13:15 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921683/ [6921684] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}} time: 02:22:41 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921684/ [6921685] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:27:43 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921685/ [6921686] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_api_tests} time: 00:41:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921686/ [6921690] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:18:25 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921690/ [6921691] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:23:45 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921691/ [6921693] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:42:39 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921693/ [6921695] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:28:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921695/ [6921697] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:16:04 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921697/ [6921699] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:21:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921699/ [6921700] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:38:01 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921700/ [6921701] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/valgrind} time: 00:32:01 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921701/ [6921703] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:21 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921703/ [6921705] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/test_rbd_api} time: 00:35:10 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921705/ [6921706] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:21:33 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921706/ [6921707] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:15:49 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921707/ [6921708] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache} time: 00:17:01 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921708/ [6921710] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:40 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921710/ [6921711] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:08:49 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921711/ [6921712] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:20:20 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921712/ [6921713] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:55 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921713/ [6921715] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:26:38 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921715/ [6921717] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:21:28 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921717/ [6921720] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} time: 00:32:07 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921720/ [6921721] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps} time: 00:48:13 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921721/ [6921724] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_mon_osdmap_prune} time: 00:45:19 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921724/ [6921725] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:22:18 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921725/ [6921726] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:34:56 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921726/ [6921728] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} time: 00:29:18 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921728/ [6921730] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:22:09 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921730/ [6921731] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:21 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921731/ [6921732] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:15:28 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921732/ [6921733] rados/multimon/{clusters/6 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:14:07 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921733/ [6921734] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/insights} time: 00:21:43 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921734/ [6921735] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:36:17 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921735/ [6921737] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:10:37 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921737/ [6921739] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:17:38 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921739/ [6921740] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:13 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921740/ [6921741] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/lockdep} time: 00:29:57 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921741/ [6921743] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:23:29 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921743/ [6921744] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:09 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921744/ [6921745] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921745/ [6921746] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:15:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921746/ [6921748] rados/singleton/{all/mon-config mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921748/ [6921749] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 02:23:41 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921749/ [6921750] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:34:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921750/ [6921751] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:28:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921751/ [6921752] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:20:53 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921752/ [6921754] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:19:29 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921754/ [6921755] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} time: 03:23:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921755/ [6921757] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} time: 00:25:18 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921757/ [6921758] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:20:27 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921758/ [6921759] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:33:56 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921759/ [6921760] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:14:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921760/ [6921762] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench} time: 01:46:36 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921762/ [6921763] rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr orchestrator_cli} time: 00:17:18 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921763/ [6921764] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:10:37 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921764/ [6921766] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} time: 00:27:36 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921766/ [6921768] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 01:04:55 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921768/ [6921769] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:17:23 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921769/ [6921772] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:24:07 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921772/ [6921773] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921773/ [6921774] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:41:30 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921774/ [6921775] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:13:10 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921775/ [6921776] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:11:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921776/ [6921777] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:53:13 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921777/ [6921778] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:14:34 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921778/ [6921779] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:13:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921779/ [6921780] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:21:44 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921780/ [6921781] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:30:14 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921781/ [6921783] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_cls_all validater/valgrind} time: 01:50:44 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921783/ [6921784] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/classic} time: 00:53:27 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921784/ [6921785] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:34:40 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921785/ [6921786] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} time: 00:49:48 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921786/ [6921787] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:39:56 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921787/ [6921788] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:29 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921788/ [6921789] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:36:55 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921789/ [6921790] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:20:11 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921790/ [6921792] rados/singleton/{all/peer mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:13:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921792/ [6921793] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:11 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921793/ [6921794] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/repair_test} time: 00:19:32 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921794/ [6921796] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect_promote_tests} time: 00:17:37 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921796/ [6921797] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:10:55 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921797/ [6921798] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:28 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921798/ [6921799] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:17:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921799/ [6921800] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:46 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921800/ [6921802] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:42:56 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921802/ [6921803] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:18 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921803/ [6921804] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:15:49 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921804/ [6921805] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:32:55 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921805/ [6921806] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:23:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921806/ [6921807] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/snaps-few-objects} time: 00:30:43 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921807/ [6921808] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:44:33 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921808/ [6921810] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921810/ [6921816] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:09:08 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921816/ [6921818] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:35:22 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921818/ [6921819] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:12:01 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921819/ [6921820] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:11:44 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921820/ [6921821] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read} time: 00:16:31 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921821/ [6921822] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:10 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921822/ [6921824] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:23:40 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921824/ [6921825] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/lockdep} time: 00:20:28 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921825/ [6921826] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:14:16 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921826/ [6921827] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:15:18 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921827/ [6921828] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:10 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921828/ [6921829] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:32:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921829/ [6921830] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:15 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921830/ [6921831] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:15 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921831/ [6921832] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:22:17 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921832/ [6921833] rados/singleton/{all/radostool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:14:27 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921833/ [6921834] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:29:18 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921834/ [6921836] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} time: 00:27:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921836/ [6921837] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:29:05 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921837/ [6921838] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:33 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921838/ [6921839] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:39:07 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921839/ [6921840] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:22:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921840/ [6921842] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:25:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921842/ [6921844] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:46:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921844/ [6921845] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:20:19 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921845/ [6921846] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:32:05 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921846/ [6921847] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:36 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921847/ [6921848] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/many workloads/pool-create-delete} time: 00:21:23 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921848/ [6921849] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:10:22 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921849/ [6921850] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921850/ [6921851] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-localized} time: 00:20:54 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921851/ [6921852] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:08 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921852/ [6921853] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:26:02 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921853/ [6921854] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:17:12 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921854/ [6921855] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:16:40 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921855/ [6921857] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:49:01 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921857/ [6921858] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:15:38 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921858/ [6921859] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:15:44 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921859/ [6921860] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:17:00 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921860/ [6921861] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:23:07 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921861/ [6921862] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} time: 02:07:09 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921862/ [6921865] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/valgrind} time: 00:34:37 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921865/ [6921866] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:15 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921866/ [6921867] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:29:34 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921867/ [6921869] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921869/ [6921870] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:18:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921870/ [6921871] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} time: 00:27:48 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921871/ [6921873] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:14:16 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921873/ [6921875] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:19:26 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921875/ [6921877] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:39:49 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921877/ [6921878] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:10:11 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921878/ [6921879] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} time: 00:33:15 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921879/ [6921881] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:30:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921881/ [6921882] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:11:05 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921882/ [6921883] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:37:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921883/ [6921884] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:27:14 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921884/ [6921885] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:18:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921885/ [6921890] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:43 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921890/ [6921891] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} time: 00:31:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921891/ [6921893] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:12:52 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921893/ [6921895] rados/multimon/{clusters/6 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:12:36 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921895/ [6921899] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:28:17 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921899/ [6921901] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 01:44:54 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921901/ [6921903] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/lockdep} time: 00:29:21 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921903/ [6921904] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:54:28 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921904/ [6921906] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921906/ [6921907] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:31 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921907/ [6921909] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:10:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921909/ [6921912] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:54:46 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921912/ [6921913] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:22:41 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921913/ [6921915] rados/objectstore/{backends/objectstore supported-random-distro$/{centos_8}} time: 04:36:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921915/ [6921916] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:10:09 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921916/ [6921917] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 01:33:21 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921917/ [6921918] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:19:09 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921918/ [6921921] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:35:40 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921921/ [6921922] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:15:50 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921922/ [6921924] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:54:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921924/ [6921926] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:26:02 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921926/ [6921927] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:27:30 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921927/ [6921929] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:23:32 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921929/ [6921930] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:18:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921930/ [6921931] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} time: 00:30:28 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921931/ [6921933] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:09:55 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921933/ [6921934] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:22:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921934/ [6921935] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:19:00 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921935/ [6921938] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:17:16 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921938/ [6921940] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:36:17 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921940/ [6921941] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:43:09 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921941/ [6921942] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:33:26 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921942/ [6921943] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/valgrind} time: 01:55:12 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921943/ [6921944] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:48:31 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921944/ [6921945] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:25:13 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921945/ [6921946] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:33:17 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921946/ [6921948] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:16:30 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921948/ [6921950] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_python} time: 00:19:27 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921950/ [6921951] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:25:56 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921951/ [6921952] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:34:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921952/ [6921953] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:17:52 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921953/ [6921955] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:30:02 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921955/ [6921959] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/dashboard} time: 02:14:46 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921959/ [6921962] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:19:52 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921962/ [6921964] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_18.04} time: 03:32:50 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921964/ [6921965] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:24:46 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921965/ [6921966] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:38:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921966/ [6921967] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:10:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921967/ [6921968] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} time: 00:25:59 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921968/ [6921969] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:17:39 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921969/ [6921970] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:34:28 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921970/ [6921973] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:18 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921973/ [6921974] rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_18.04} 2-node-mgr orchestrator_cli} time: 00:19:19 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921974/ [6921975] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:22 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921975/ [6921976] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:46:33 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921976/ [6921977] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} time: 00:29:15 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921977/ [6921978] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:19:23 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921978/ [6921979] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/failover} time: 00:21:38 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921979/ [6921980] rados/multimon/{clusters/21 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:29:13 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921980/ [6921982] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:33:17 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921982/ [6921985] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:21:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921985/ [6921986] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:14:30 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921986/ [6921987] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:18:20 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921987/ [6921988] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:41:57 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921988/ [6921989] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/lockdep} time: 00:17:52 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921989/ [6921990] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:33:40 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921990/ [6921991] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:16:49 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921991/ [6921992] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921992/ [6921993] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:10:26 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921993/ [6921994] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:33:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921994/ [6921995] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:19:29 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921995/ [6921996] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:10:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921996/ [6921998] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps} time: 00:25:50 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6921998/ [6922001] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} time: 00:19:09 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922001/ [6922002] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:14:11 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922002/ [6922003] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:20:10 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922003/ [6922004] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:37:14 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922004/ [6922005] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} time: 00:18:01 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922005/ [6922006] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922006/ [6922009] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:17:25 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922009/ [6922010] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:13:09 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922010/ [6922011] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:10:08 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922011/ [6922012] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:36:36 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922012/ [6922014] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:29:56 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922014/ [6922015] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:31:43 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922015/ [6922016] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:37:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922016/ [6922020] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:12:13 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922020/ [6922021] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:22:57 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922021/ [6922022] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:09:38 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922022/ [6922023] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922023/ [6922024] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:10:21 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922024/ [6922025] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:24:08 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922025/ [6922026] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:52:38 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922026/ [6922028] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:19:57 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922028/ [6922029] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} time: 00:50:13 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922029/ [6922031] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:41:19 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922031/ [6922035] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:48:49 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922035/ [6922037] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:23:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922037/ [6922038] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:32:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922038/ [6922043] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:36:33 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922043/ [6922044] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:31:29 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922044/ [6922045] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:59 info: http://pulpito.ceph.com/teuthology-2022-07-10_03:31:03-rados-pacific-distro-default-smithi/6922045/